Sep 28 12:06:04 devstack cinder-volume[76013]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 12:06:04 devstack cinder-volume[76013]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 12:06:04 devstack cinder-volume[76013]: we strongly recommend against using it for new projects. Sep 28 12:06:04 devstack cinder-volume[76013]: If you are already using Eventlet, we recommend migrating to a different Sep 28 12:06:04 devstack cinder-volume[76013]: framework. For more detail see Sep 28 12:06:04 devstack cinder-volume[76013]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 12:06:04 devstack cinder-volume[76013]: import eventlet # noqa Sep 28 12:06:06 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:06:06 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:06:06 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:06:07 devstack cinder-volume[76013]: INFO dbcounter [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Registered counter for database cinder Sep 28 12:06:07 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:06:08 devstack cinder-volume[76013]: DEBUG dbcounter [-] [76013] Writer thread running {{(pid=76013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:06:08 devstack cinder-volume[76013]: INFO cinder.rpc [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 12:06:08 devstack cinder-volume[76013]: INFO cinder.rpc [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 12:06:08 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:06:08 devstack cinder-volume[76013]: INFO cinder.volume.manager [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Determined volume DB was empty at startup. Sep 28 12:06:08 devstack cinder-volume[76013]: DEBUG cinder.volume.manager [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76013) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 12:06:08 devstack cinder-volume[76013]: INFO cinder.volume.manager [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 12:06:08 devstack cinder-volume[76013]: WARNING stevedore.named [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 12:06:08 devstack cinder-volume[76013]: WARNING castellan.key_manager [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:06:08 devstack cinder-volume[76013]: WARNING cinder.keymgr.conf_key_mgr [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:06:08 devstack cinder-volume[76013]: DEBUG cinder.volume.drivers.lvm [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76013) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 12:06:08 devstack cinder-volume[76013]: DEBUG oslo_concurrency.processutils [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:08 devstack cinder-volume[76013]: DEBUG oslo_concurrency.processutils [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] CMD "cinder-rtstool verify" returned: 0 in 0.432s {{(pid=76013) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:08 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:06:08 devstack cinder-volume[76013]: INFO cinder.rpc [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 12:06:08 devstack cinder-volume[76013]: INFO cinder.rpc [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 12:06:08 devstack cinder-volume[76013]: WARNING stevedore.named [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 12:06:08 devstack cinder-volume[76013]: WARNING castellan.key_manager [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:06:09 devstack cinder-volume[76013]: INFO cinder.volume.manager [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_db.sqlalchemy.engines [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76013) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:06:09 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Starting 1 workers Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Started child 76172 {{(pid=76013) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Full set of CONF: {{(pid=76013) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] ******************************************************************************** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Configuration options gathered from: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] ================================================================================ {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] allow_availability_zone_fallback = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] allow_compression_on_image_upload = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] allowed_direct_url_schemes = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] api_rate_limit = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] auth_strategy = keystone {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] az_cache_duration = 3600 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_host = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_stats_polling_interval = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76172]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backup_api_class = cinder.backup.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backup_name_template = backup-%s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backup_use_same_host = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backup_use_temp_snapshot = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] chap_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] chap_username = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cinder_internal_tenant_project_id = 997274dba951457ea1bd2dc8dcf497fe {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cinder_internal_tenant_user_id = e71b069efad149c9a3aa7d5f303ce146 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cloned_volume_same_az = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cluster = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] compression_format = gzip {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] compute_api_class = cinder.compute.nova.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] config_dir = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] config_source = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] control_exchange = openstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] debug = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] default_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] default_group_type = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] default_volume_type = lvmdriver-1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] disk_geometry = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] driver_client_cert = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] driver_client_cert_key = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] driver_data_namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] driver_ssl_cert_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] driver_ssl_cert_verify = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] driver_use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] enable_force_upload = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] enable_new_services = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] enable_unsupported_driver = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] enforce_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] filter_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_api_insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_api_servers = ['http://192.168.122.186/image'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_api_ssl_compression = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_ca_certificates_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_catalog_info = image:glance:publicURL {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_num_retries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance_request_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] goodness_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] graceful_shutdown_timeout = 5 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] group_api_class = cinder.group.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] host = devstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_compress_on_upload = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_conversion_address_space_limit = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_conversion_cpu_limit = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_conversion_disable = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_introspection_address_space_limit = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_introspection_cpu_limit = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_upload_use_cinder_backend = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_upload_use_internal_tenant = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_volume_cache_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_volume_cache_max_count = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] image_volume_cache_max_size_gb = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] init_host_max_objects_retrieval = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] instance_format = [instance: %(uuid)s] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] iscsi_target_flags = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] iscsi_write_cache = on {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] iser_helper = tgtadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] iser_ip_address = 192.168.122.186 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] iser_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] log_color = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] log_config_append = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] log_dir = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] log_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] log_options = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] log_rotate_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] log_rotate_interval_type = days {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] log_rotation_type = none {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] max_age = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] max_logfile_count = 30 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] max_logfile_size_mb = 200 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] max_over_subscription_ratio = 20.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] message_reap_interval = 86400 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] message_ttl = 2592000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] migration_create_volume_timeout_secs = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] monkey_patch = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] monkey_patch_modules = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] my_ip = 192.168.122.186 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] no_snapshot_gb_quota = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] num_iser_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] num_shell_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] num_volume_device_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] nvmeof_conn_info_version = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] nvmet_ns_id = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] nvmet_port_id = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] osapi_max_limit = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] osapi_volume_ext_list = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] osapi_volume_listen_port = 8776 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] osapi_volume_use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] osapi_volume_workers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] per_volume_size_limit = -1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] periodic_fuzzy_delay = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] periodic_interval = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] public_endpoint = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] publish_errors = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] quota_backup_gigabytes = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] quota_backups = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] quota_gigabytes = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] quota_groups = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] quota_snapshots = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] quota_volumes = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] rate_limit_burst = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] rate_limit_except_level = CRITICAL {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] rate_limit_interval = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] reinit_driver_count = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] replication_device = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] report_discard_supported = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] report_interval = 120 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] reservation_clean_interval = 86400 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] reservation_expire = 86400 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] reserved_image_namespaces = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] reserved_percentage = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] rpc_response_timeout = 120 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] run_external_periodic_tasks = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] scst_target_driver = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] scst_target_iqn_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_down_time = 720 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] shell_completion = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] snapshot_name_template = snapshot-%s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] snapshot_same_host = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] state_path = /opt/stack/data/cinder {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] storage_availability_zone = nova {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] storage_protocol = iSCSI {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] syslog_log_facility = LOG_USER {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] target_helper = lioadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] target_ip_address = 192.168.122.186 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] target_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] target_protocol = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] target_secondary_ip_addresses = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] trace_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] transport_url = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] until_refresh = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] use_chap_auth = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] use_default_quota_class = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] use_journal = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] use_json = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] use_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] use_stderr = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] use_syslog = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] verify_glance_signatures = enabled {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_api_class = cinder.volume.api.API {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_backend_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_clear = zero {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_clear_ionice = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_clear_size = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_copy_bps_limit = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_dd_blocksize = 1M {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_name_template = volume-%s {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_service_inithost_offload = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volume_usage_audit_period = month {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] zoning_mode = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_concurrency.disable_process_locking = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.auth_type = password {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.auth_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.cache = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.include_service_catalog = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.interface = public {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcache_username = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.region_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.073s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.service_type = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.186/identity {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.backend = dogpile.cache.null {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.backend_argument = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.backend_expiration_time = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.config_prefix = cache.oslo {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.debug_cache_backend = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.enable_retry_client = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.enable_socket_keepalive = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.expiration_time = 600 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.hashclient_retry_attempts = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.memcache_dead_retry = 300 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.memcache_pool_maxsize = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.memcache_sasl_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.proxies = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.redis_db = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.redis_server = localhost:6379 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.retry_attempts = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.retry_delay = 0.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.socket_keepalive_count = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.socket_keepalive_idle = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.socket_keepalive_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.socket_timeout = 1.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.tls_allowed_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.tls_cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.tls_certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.tls_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.tls_keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cache.username = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] coordination.backend_url = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.asyncio_connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.asyncio_slave_connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.backend = sqlalchemy {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.connection_debug = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.connection_parameters = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.connection_recycle_time = 3600 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.connection_trace = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.db_inc_retry_interval = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.db_max_retries = 20 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.db_max_retry_interval = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.db_retry_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.max_overflow = 50 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.max_pool_size = 5 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.max_retries = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.mysql_wsrep_sync_wait = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.pool_timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.retry_interval = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.slave_connection = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.sqlite_synchronous = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.synchronous_reader = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] database.use_db_reconnect = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_tracing.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.connection_string = messaging:// {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.es_doc_type = notification {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.es_scroll_size = 10000 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.es_scroll_time = 2m {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.filter_error_trace = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.hmac_keys = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.sentinel_service_name = mymaster {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.socket_timeout = 0.1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.trace_requests = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler.trace_sqlalchemy = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler_jaeger.process_tags = {} {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler_jaeger.service_name_prefix = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] profiler_otlp.service_name_prefix = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.enforce_new_defaults = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.policy_default_rule = default {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.policy_file = policy.yaml {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] privsep_osbrick.group = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] privsep_osbrick.helper_command = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] privsep_osbrick.user = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cinder_sys_admin.group = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cinder_sys_admin.helper_command = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] cinder_sys_admin.user = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.auth_type = password {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.send_service_user_token = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.tls_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] service_user.tls_min_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.auth_type = password {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.region_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.tls_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] glance.tls_min_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.backend_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.chap_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.chap_username = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.disk_geometry = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.driver_client_cert = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.driver_client_cert_key = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.driver_data_namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.driver_use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.extra_capabilities = {} {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.filter_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.goodness_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.iscsi_target_flags = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.iscsi_write_cache = on {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.iser_helper = tgtadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.iser_ip_address = 192.168.122.186 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.iser_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.lvm_share_target = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.lvm_type = auto {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.num_shell_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.replication_device = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.report_discard_supported = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.reserved_percentage = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.target_helper = tgtadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.target_ip_address = 192.168.122.186 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.target_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.target_protocol = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.trace_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.unique_fqdn_network = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.use_chap_auth = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volume_backend_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volume_clear = zero {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volume_clear_ionice = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volume_clear_size = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_reports.file_event_handler = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_reports.log_dir = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack sudo[76183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 12:06:09 devstack sudo[76183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.backend_host = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.chap_password = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.chap_username = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.disk_geometry = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.driver_client_cert = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.extra_capabilities = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.filter_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.goodness_function = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.iser_helper = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.iser_ip_address = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.iser_port = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.lvm_share_target = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.lvm_type = auto {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.num_shell_tries = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.replication_device = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.report_discard_supported = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.reserved_percentage = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.scst_target_driver = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.storage_protocol = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.target_helper = lioadm {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.target_ip_address = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.target_port = 3260 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.trace_flags = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.use_chap_auth = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volume_clear = zero {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volume_clear_size = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] lvmdriver-1.volumes_dir = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_notifications.driver = [] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_notifications.retry = -1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] key_manager.fixed_key = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.barbican_api_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.barbican_endpoint = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.barbican_endpoint_type = public {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.barbican_region_name = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.number_of_retries = 60 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.retry_delay = 1 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.send_service_user_token = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.tls_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.tls_min_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.verify_ssl = True {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican.verify_ssl_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.auth_section = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.auth_type = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.cafile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.certfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.collect_timing = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.insecure = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.keyfile = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.split_loggers = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.timeout = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.tls_ciphers = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] barbican_service_user.tls_min_version = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.approle_role_id = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.approle_secret_id = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.auth_method = approle {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.auth_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.kv_mountpoint = secret {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.kv_path = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.kv_version = 2 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.namespace = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.root_token_id = **** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.ssl_ca_crt_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.timeout = 60.0 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.token_file = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.token_role = None {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.use_ssl = False {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:06:09 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] ******************************************************************************** {{(pid=76013) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 12:06:09 devstack sudo[76183]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:09 devstack sudo[76186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:09 devstack sudo[76186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:09 devstack sudo[76186]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.246s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:06:09 devstack cinder-volume[76172]: INFO cinder.brick.local_dev.lvm [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:09 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:09 devstack sudo[76302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:06:09 devstack sudo[76302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:10 devstack sudo[76302]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:10 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:10 devstack cinder-volume[76172]: DEBUG cinder.brick.local_dev.lvm [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76172) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 12:06:10 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:10 devstack sudo[76390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:10 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:10 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:10 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.531s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:10 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:10 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:10 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:10 devstack sudo[76589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:10 devstack sudo[76589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:11 devstack sudo[76589]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:11 devstack sudo[76675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 12:06:11 devstack sudo[76675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:11 devstack sudo[76675]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.255s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:11 devstack sudo[76763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:06:11 devstack sudo[76763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:11 devstack sudo[76763]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:11 devstack sudo[76792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:06:11 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:11 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:11 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:11 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:06:11 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:12 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.341s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:12 devstack sudo[76878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:12 devstack sudo[76878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:12 devstack sudo[76878]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:12 devstack sudo[76893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:12 devstack sudo[76893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:12 devstack sudo[76893]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:12 devstack cinder-volume[76172]: INFO cinder.volume.drivers.lvm [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:12 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:12 devstack sudo[76978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:12 devstack sudo[76978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:13 devstack sudo[76978]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:13 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:13 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:06:13 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:13 devstack sudo[76981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:06:13 devstack sudo[76981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:13 devstack sudo[76981]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:13 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:13 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:13 devstack sudo[76984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:06:13 devstack sudo[76984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:13 devstack sudo[76984]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:13 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:13 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:13 devstack sudo[76987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:13 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:14 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:14 devstack sudo[76990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:06:14 devstack sudo[76990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:14 devstack sudo[76990]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:14 devstack cinder-volume[76172]: INFO cinder.volume.driver [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Driver hasn't implemented _init_vendor_properties() Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG cinder.volume.driver [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76172) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:886}} Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG oslo_db.sqlalchemy.engines [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76172) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writer thread running {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG cinder.db.api [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Building query based on filter {{(pid=76172) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG cinder.image.image_utils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76172) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 12:06:14 devstack cinder-volume[76172]: INFO cinder.keymgr.migration [None req-cfe3c744-05e9-482b-b058-f129823e575e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:14 devstack sudo[76995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:06:14 devstack sudo[76995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:14 devstack sudo[76995]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.308s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:14 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:14 devstack sudo[76998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:06:14 devstack sudo[76998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:15 devstack sudo[76998]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:15 devstack sudo[77003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:15 devstack sudo[77003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:15 devstack sudo[77003]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:15 devstack sudo[77006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:06:15 devstack sudo[77006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:15 devstack sudo[77006]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:06:15 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Driver initialization completed successfully. Sep 28 12:06:15 devstack cinder-volume[76172]: INFO cinder.manager [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Initiating service 2 cleanup Sep 28 12:06:15 devstack cinder-volume[76172]: INFO cinder.manager [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Service 2 cleanup completed. Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG cinder.service [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Creating RPC server for service cinder-volume {{(pid=76172) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG cinder.service [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76172) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 12:06:15 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:06:15 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:15 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:06:15 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:16 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:16 devstack sudo[77015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:06:16 devstack sudo[77015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:16 devstack sudo[77015]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:16 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:06:16 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:16 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:06:16 devstack sudo[77023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:06:16 devstack sudo[77023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:06:16 devstack sudo[77023]: pam_unix(sudo:session): session closed for user root Sep 28 12:06:16 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:06:16 devstack cinder-volume[76172]: INFO cinder.volume.manager [None req-b5498a6e-3803-4d22-99c4-08aaa9c575df None None] Driver post RPC initialization completed successfully. Sep 28 12:06:19 devstack cinder-volume[76013]: DEBUG dbcounter [-] [76013] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76013) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:06:26 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:06:26 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:06:36 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:06:36 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:06:36 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] thread info: [<_MainThread(MainThread, started 135906913300608)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:07:36 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:07:36 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:07:36 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:36 devstack sudo[79648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:07:36 devstack sudo[79648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:37 devstack sudo[79648]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:37 devstack sudo[79651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:07:37 devstack sudo[79651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:37 devstack sudo[79651]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:37 devstack sudo[79654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:07:37 devstack sudo[79654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:37 devstack sudo[79654]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:07:37 devstack sudo[79658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:07:37 devstack sudo[79658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:07:37 devstack sudo[79658]: pam_unix(sudo:session): session closed for user root Sep 28 12:07:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:07:37 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:07:38 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:07:38 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:07:38 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] thread info: [<_MainThread(MainThread, started 135906913300608)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:08:26 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:08:26 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:08:36 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:08:36 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:08:36 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:36 devstack sudo[82641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:08:36 devstack sudo[82641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:37 devstack sudo[82641]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:37 devstack sudo[82644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:08:37 devstack sudo[82644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:37 devstack sudo[82644]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:37 devstack sudo[82647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:08:37 devstack sudo[82647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:37 devstack sudo[82647]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:08:37 devstack sudo[82651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:08:37 devstack sudo[82651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:08:38 devstack sudo[82651]: pam_unix(sudo:session): session closed for user root Sep 28 12:08:38 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:08:38 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:08:38 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:08:38 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:08:38 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] thread info: [<_MainThread(MainThread, started 135906913300608)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:09:36 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:09:36 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:09:36 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:09:36 devstack sudo[84847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:09:36 devstack sudo[84847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:09:37 devstack sudo[84847]: pam_unix(sudo:session): session closed for user root Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:09:37 devstack sudo[84850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:09:37 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:09:37 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:09:37 devstack sudo[84853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:09:37 devstack sudo[84853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:09:37 devstack sudo[84853]: pam_unix(sudo:session): session closed for user root Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:09:37 devstack sudo[84857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:09:37 devstack sudo[84857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:09:37 devstack sudo[84857]: pam_unix(sudo:session): session closed for user root Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running periodic task VolumeManager._thread_info {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] thread count: 6 {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:09:37 devstack cinder-volume[76172]: DEBUG cinder.volume.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] thread info: [<_MainThread(MainThread, started 135906913300608)>, , , , , ] {{(pid=76172) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:10:26 devstack cinder-volume[76172]: DEBUG dbcounter [-] [76172] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76172) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:10:36 devstack cinder-volume[76172]: DEBUG oslo_service.periodic_task [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76172) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:10:36 devstack cinder-volume[76172]: DEBUG cinder.volume.drivers.lvm [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Updating volume stats {{(pid=76172) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 12:10:36 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:36 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 12:10:36 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:37 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.304s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:37 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:10:37 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:37 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:37 devstack sudo[86164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 12:10:37 devstack sudo[86164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:37 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Caught SIGTERM, stopping children Sep 28 12:10:37 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Acquiring lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:10:37 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Acquired lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:10:37 devstack cinder-volume[76013]: DEBUG oslo_concurrency.lockutils [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Releasing lock "singleton_lock" {{(pid=76013) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:10:37 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Stop services. {{(pid=76013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 12:10:37 devstack cinder-volume[76013]: DEBUG oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Killing children. {{(pid=76013) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 12:10:37 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Waiting on 1 children to exit Sep 28 12:10:37 devstack sudo[86164]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:37 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:37 devstack sudo[86169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 12:10:37 devstack sudo[86169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:38 devstack sudo[86169]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:38 devstack cinder-volume[76172]: DEBUG oslo_concurrency.processutils [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76172) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:38 devstack cinder-volume[76172]: DEBUG cinder.manager [None req-74707344-f795-489d-b2a4-bfe717154bd9 None None] Notifying Schedulers of capabilities ... {{(pid=76172) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:10:40 devstack cinder-volume[76172]: DEBUG oslo_concurrency.lockutils [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Acquiring lock "singleton_lock" {{(pid=76172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:10:40 devstack cinder-volume[76172]: DEBUG oslo_concurrency.lockutils [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Acquired lock "singleton_lock" {{(pid=76172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:10:40 devstack cinder-volume[76172]: DEBUG oslo_concurrency.lockutils [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Releasing lock "singleton_lock" {{(pid=76172) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:10:40 devstack cinder-volume[76172]: WARNING amqp [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 12:10:40 devstack cinder-volume[76172]: WARNING amqp [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 12:10:40 devstack cinder-volume[76013]: INFO oslo_service.backend._eventlet.service [None req-cde7bf2c-4680-427f-989e-fe482d7a34a5 None None] Child 76172 exited with status 0 Sep 28 12:10:41 devstack cinder-volume[86174]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 12:10:41 devstack cinder-volume[86174]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 12:10:41 devstack cinder-volume[86174]: we strongly recommend against using it for new projects. Sep 28 12:10:41 devstack cinder-volume[86174]: If you are already using Eventlet, we recommend migrating to a different Sep 28 12:10:41 devstack cinder-volume[86174]: framework. For more detail see Sep 28 12:10:41 devstack cinder-volume[86174]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 12:10:41 devstack cinder-volume[86174]: import eventlet # noqa Sep 28 12:10:43 devstack cinder-volume[86174]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:10:43 devstack cinder-volume[86174]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:10:43 devstack cinder-volume[86174]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:10:44 devstack cinder-volume[86174]: INFO dbcounter [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Registered counter for database cinder Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_db.sqlalchemy.engines [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG dbcounter [-] [86174] Writer thread running {{(pid=86174) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:10:44 devstack cinder-volume[86174]: INFO cinder.rpc [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 12:10:44 devstack cinder-volume[86174]: INFO cinder.rpc [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_db.sqlalchemy.engines [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:10:44 devstack cinder-volume[86174]: INFO cinder.volume.manager [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Determined volume DB was empty at startup. Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG cinder.volume.manager [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86174) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 12:10:44 devstack cinder-volume[86174]: INFO cinder.volume.manager [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 12:10:44 devstack cinder-volume[86174]: WARNING stevedore.named [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 12:10:44 devstack cinder-volume[86174]: WARNING castellan.key_manager [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:10:44 devstack cinder-volume[86174]: WARNING cinder.keymgr.conf_key_mgr [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:10:44 devstack cinder-volume[86174]: INFO cinder.volume.manager [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_db.sqlalchemy.engines [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86174) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:10:44 devstack cinder-volume[86174]: INFO oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Starting 1 workers Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Started child 86389 {{(pid=86174) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Full set of CONF: {{(pid=86174) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] ******************************************************************************** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Configuration options gathered from: {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] ================================================================================ {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] allow_availability_zone_fallback = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] allow_compression_on_image_upload = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86389]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] allowed_direct_url_schemes = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] api_rate_limit = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] auth_strategy = keystone {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_availability_zone = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_host = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_stats_polling_interval = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backup_api_class = cinder.backup.api.API {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backup_name_template = backup-%s {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backup_use_same_host = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backup_use_temp_snapshot = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] chap_password = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] chap_username = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cinder_internal_tenant_project_id = 997274dba951457ea1bd2dc8dcf497fe {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cinder_internal_tenant_user_id = e71b069efad149c9a3aa7d5f303ce146 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cluster = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] compression_format = gzip {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] compute_api_class = cinder.compute.nova.API {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] config_dir = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] config_source = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] control_exchange = openstack {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] debug = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] default_availability_zone = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] default_group_type = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] default_volume_type = QuobyteHD {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] disk_geometry = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] driver_client_cert = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] driver_client_cert_key = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] driver_data_namespace = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] driver_ssl_cert_path = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] driver_ssl_cert_verify = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] driver_use_ssl = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] enable_new_services = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] enable_unsupported_driver = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] enabled_backends = ['QuobyteHD'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] enforce_multipath_for_image_xfer = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] filter_function = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_api_insecure = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_api_servers = ['http://192.168.122.186/image'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_api_ssl_compression = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_ca_certificates_file = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_catalog_info = image:glance:publicURL {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_certfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_keyfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_num_retries = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance_request_timeout = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] goodness_function = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] graceful_shutdown_timeout = 5 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] group_api_class = cinder.group.api.API {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] host = devstack {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_compress_on_upload = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_conversion_address_space_limit = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_conversion_cpu_limit = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_conversion_disable = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_introspection_address_space_limit = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_introspection_cpu_limit = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_upload_use_cinder_backend = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_upload_use_internal_tenant = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_volume_cache_enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_volume_cache_max_count = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] image_volume_cache_max_size_gb = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] init_host_max_objects_retrieval = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] instance_format = [instance: %(uuid)s] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] iscsi_target_flags = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] iscsi_write_cache = on {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] iser_helper = tgtadm {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] iser_ip_address = 192.168.122.186 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] iser_port = 3260 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] log_color = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] log_config_append = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] log_dir = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] log_file = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] log_options = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] log_rotate_interval = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] log_rotate_interval_type = days {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] log_rotation_type = none {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] max_age = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] max_logfile_count = 30 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] max_logfile_size_mb = 200 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] max_over_subscription_ratio = 20.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] message_reap_interval = 86400 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] message_ttl = 2592000 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] migration_create_volume_timeout_secs = 300 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] monkey_patch = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] monkey_patch_modules = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 12:10:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86389) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] my_ip = 192.168.122.186 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] no_snapshot_gb_quota = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] num_iser_scan_tries = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] num_shell_tries = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] num_volume_device_scan_tries = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] nvmeof_conn_info_version = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] nvmet_ns_id = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] nvmet_port_id = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] osapi_max_limit = 1000 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] osapi_volume_ext_list = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] osapi_volume_listen = 0.0.0.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] osapi_volume_listen_port = 8776 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] osapi_volume_use_ssl = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] osapi_volume_workers = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] per_volume_size_limit = -1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] periodic_fuzzy_delay = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] periodic_interval = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] project_id_regex = [0-9a-f\-]+ {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] public_endpoint = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] publish_errors = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] quota_backup_gigabytes = 1000 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] quota_backups = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] quota_gigabytes = 1000 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] quota_groups = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] quota_snapshots = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] quota_volumes = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] rate_limit_burst = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] rate_limit_except_level = CRITICAL {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] rate_limit_interval = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] reinit_driver_count = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] replication_device = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] report_discard_supported = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] report_interval = 120 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] reservation_clean_interval = 86400 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] reservation_expire = 86400 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] reserved_image_namespaces = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] reserved_percentage = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] rpc_response_timeout = 120 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] run_external_periodic_tasks = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] scst_target_driver = iscsi {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] scst_target_iqn_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_down_time = 720 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] shell_completion = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] snapshot_name_template = snapshot-%s {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] split_loggers = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] state_path = /opt/stack/data/cinder {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] storage_availability_zone = nova {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] storage_protocol = iSCSI {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] syslog_log_facility = LOG_USER {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] target_helper = lioadm {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] target_ip_address = 192.168.122.186 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] target_port = 3260 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] target_protocol = iscsi {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] target_secondary_ip_addresses = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] trace_flags = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] transfer_api_class = cinder.transfer.api.API {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] transport_url = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] until_refresh = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] use_chap_auth = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] use_default_quota_class = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] use_journal = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] use_json = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] use_multipath_for_image_xfer = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] use_stderr = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] use_syslog = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] verify_glance_signatures = enabled {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_api_class = cinder.volume.api.API {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_backend_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_clear = zero {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_clear_ionice = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_clear_size = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_copy_bps_limit = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_dd_blocksize = 1M {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_name_template = volume-%s {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_service_inithost_offload = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volume_usage_audit_period = month {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] zoning_mode = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_concurrency.disable_process_locking = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.auth_section = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.auth_type = password {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.auth_version = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.cache = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.certfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.delay_auth_decision = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.http_connect_timeout = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.include_service_catalog = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.insecure = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.interface = public {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.keyfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_password = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcache_username = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.region_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.service_token_roles_required = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.service_type = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.token_cache_time = 300 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.186/identity {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.backend = dogpile.cache.null {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.backend_argument = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.backend_expiration_time = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.config_prefix = cache.oslo {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.debug_cache_backend = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.enable_retry_client = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.enable_socket_keepalive = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.expiration_time = 600 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.hashclient_retry_attempts = 2 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.memcache_dead_retry = 300 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.memcache_pool_maxsize = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.memcache_sasl_enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.password = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.proxies = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.redis_db = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.redis_sentinel_service_name = mymaster {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86389) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 12:10:44 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 12:10:44 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.redis_server = localhost:6379 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.retry_attempts = 2 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Running cmd (subprocess): mount.quobyte {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.retry_delay = 0.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.socket_keepalive_count = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.socket_keepalive_idle = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.socket_keepalive_interval = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.socket_timeout = 1.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.tls_allowed_ciphers = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.tls_cafile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.tls_certfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:44 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.tls_enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.tls_keyfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cache.username = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] coordination.backend_url = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.asyncio_connection = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.asyncio_slave_connection = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.backend = sqlalchemy {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.connection = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.connection_debug = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.connection_parameters = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.connection_recycle_time = 3600 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.connection_trace = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.db_inc_retry_interval = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.db_max_retries = 20 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.db_max_retry_interval = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.db_retry_interval = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.max_overflow = 50 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.max_pool_size = 5 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.max_retries = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.mysql_wsrep_sync_wait = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.pool_timeout = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.retry_interval = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.slave_connection = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.sqlite_synchronous = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.synchronous_reader = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] database.use_db_reconnect = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_tracing.insecure = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.connection_string = messaging:// {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.es_doc_type = notification {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.es_scroll_size = 10000 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.es_scroll_time = 2m {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.filter_error_trace = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.hmac_keys = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.sentinel_service_name = mymaster {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.socket_timeout = 0.1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.trace_requests = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler.trace_sqlalchemy = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler_jaeger.process_tags = {} {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler_jaeger.service_name_prefix = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] profiler_otlp.service_name_prefix = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.enforce_new_defaults = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.policy_default_rule = default {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.policy_file = policy.yaml {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_policy.remote_timeout = 60.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] privsep_osbrick.group = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] privsep_osbrick.helper_command = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] privsep_osbrick.user = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cinder_sys_admin.group = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cinder_sys_admin.helper_command = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] cinder_sys_admin.user = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.auth_section = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.auth_type = password {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.cafile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.certfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.collect_timing = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.insecure = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.keyfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.send_service_user_token = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.split_loggers = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.timeout = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.tls_ciphers = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] service_user.tls_min_version = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.auth_section = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.auth_type = password {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.certfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.collect_timing = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.insecure = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.keyfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.region_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.split_loggers = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.timeout = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.tls_ciphers = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] glance.tls_min_version = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.backend_availability_zone = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.chap_password = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.chap_username = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.disk_geometry = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.driver_client_cert = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.driver_client_cert_key = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.driver_data_namespace = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.driver_use_ssl = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.enable_unsupported_driver = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.extra_capabilities = {} {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.filter_function = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.goodness_function = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.iscsi_target_flags = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.iscsi_write_cache = on {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.iser_helper = tgtadm {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.iser_ip_address = 192.168.122.186 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.iser_port = 3260 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_host = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_login = admin {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_mount_options = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_password = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_private_key = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_share_path = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_ssh_port = 22 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.num_shell_tries = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.nvmet_port_id = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.quobyte_client_cfg = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.quobyte_volume_url = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.replication_device = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.report_discard_supported = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.reserved_percentage = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.scst_target_driver = iscsi {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.scst_target_iqn_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.storage_protocol = iSCSI {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.target_helper = tgtadm {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.target_ip_address = 192.168.122.186 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.target_port = 3260 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.target_protocol = iscsi {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.trace_flags = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.unique_fqdn_network = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.use_chap_auth = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.volume_backend_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.volume_clear = zero {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.volume_clear_ionice = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.volume_clear_size = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_reports.file_event_handler = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_reports.log_dir = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.backend_availability_zone = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.backend_host = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.chap_password = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.chap_username = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.chiscsi_conf = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.disk_geometry = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.driver_client_cert = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.driver_client_cert_key = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.driver_data_namespace = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.driver_use_ssl = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.extra_capabilities = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.filter_function = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.goodness_function = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.iscsi_target_flags = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.iscsi_write_cache = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.iser_helper = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.iser_ip_address = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.iser_port = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.iser_target_prefix = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_host = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_login = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_mount_options = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_password = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_private_key = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_share_path = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_ssh_port = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.num_shell_tries = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nvmet_ns_id = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.nvmet_port_id = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.replication_device = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.report_discard_supported = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.reserved_percentage = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.scst_target_driver = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.storage_protocol = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.target_helper = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.target_ip_address = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.target_port = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.target_prefix = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.target_protocol = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.trace_flags = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.unique_fqdn_network = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.use_chap_auth = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.volume_clear = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.volume_clear_ionice = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.volume_clear_size = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] QuobyteHD.volumes_dir = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.ssl = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.ssl_version = {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_notifications.driver = [] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_notifications.retry = -1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] oslo_messaging_notifications.transport_url = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] key_manager.fixed_key = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.barbican_api_version = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.barbican_endpoint = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.barbican_endpoint_type = public {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.barbican_region_name = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.cafile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.certfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.collect_timing = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.insecure = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.keyfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.number_of_retries = 60 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.retry_delay = 1 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.send_service_user_token = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.split_loggers = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.timeout = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.tls_ciphers = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.tls_min_version = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.verify_ssl = True {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican.verify_ssl_path = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.auth_section = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.auth_type = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.cafile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.certfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.collect_timing = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.insecure = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.keyfile = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.split_loggers = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.timeout = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.tls_ciphers = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] barbican_service_user.tls_min_version = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.approle_role_id = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.approle_secret_id = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack quobyte-client[86392]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 12:10:45 devstack quobyte-client[86392]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.auth_method = approle {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.auth_path = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.kv_mountpoint = secret {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.kv_path = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.kv_version = 2 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.namespace = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.root_token_id = **** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.ssl_ca_crt_file = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.timeout = 60.0 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.token_file = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.token_role = None {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.use_ssl = False {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:45 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] ******************************************************************************** {{(pid=86174) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] CMD "mount.quobyte" returned: 1 in 0.141s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:45 devstack cinder-volume[86389]: INFO cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a ... Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 -c /etc/quobyte/client-cinder.cfg {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:45 devstack sudo[86395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 -c /etc/quobyte/client-cinder.cfg Sep 28 12:10:45 devstack sudo[86395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:45 devstack sudo[86395]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.382s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:45 devstack cinder-volume[86389]: INFO cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a succeeded Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.393s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:45 devstack sudo[86494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:10:45 devstack sudo[86494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:45 devstack sudo[86494]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.229s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:45 devstack cinder-volume[86389]: INFO cinder.volume.driver [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG cinder.volume.driver [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2098579406738, 'free_capacity_gb': 1775.2098579406738, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86389) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:886}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_db.sqlalchemy.engines [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86389) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writer thread running {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG cinder.db.api [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Building query based on filter {{(pid=86389) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86389) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 12:10:45 devstack cinder-volume[86389]: INFO cinder.keymgr.migration [None req-83890a76-08a3-42fc-b0e3-a84c0fee92ec None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:45 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:45 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:10:45 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:46 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.244s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:10:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Driver initialization completed successfully. Sep 28 12:10:46 devstack cinder-volume[86389]: INFO cinder.manager [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Initiating service 3 cleanup Sep 28 12:10:46 devstack cinder-volume[86389]: INFO cinder.manager [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Service 3 cleanup completed. Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG cinder.service [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Creating RPC server for service cinder-volume {{(pid=86389) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG cinder.service [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86389) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 12:10:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:46 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:10:46 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:10:46 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Sep 28 12:10:46 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.263s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:46 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-7eab2a71-7ff1-4063-9e52-e6e98871b809 None None] Driver post RPC initialization completed successfully. Sep 28 12:10:50 devstack cinder-volume[86174]: INFO oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Caught SIGTERM, stopping children Sep 28 12:10:50 devstack cinder-volume[86174]: DEBUG oslo_concurrency.lockutils [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Acquiring lock "singleton_lock" {{(pid=86174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:10:50 devstack cinder-volume[86174]: DEBUG oslo_concurrency.lockutils [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Acquired lock "singleton_lock" {{(pid=86174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:10:50 devstack cinder-volume[86174]: DEBUG oslo_concurrency.lockutils [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Releasing lock "singleton_lock" {{(pid=86174) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:10:50 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Stop services. {{(pid=86174) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 12:10:50 devstack cinder-volume[86174]: DEBUG oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Killing children. {{(pid=86174) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 12:10:50 devstack cinder-volume[86174]: INFO oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Waiting on 1 children to exit Sep 28 12:10:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Acquiring lock "singleton_lock" {{(pid=86389) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:10:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Acquired lock "singleton_lock" {{(pid=86389) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:10:54 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Releasing lock "singleton_lock" {{(pid=86389) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:10:54 devstack cinder-volume[86389]: WARNING amqp [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 12:10:54 devstack cinder-volume[86389]: WARNING amqp [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 12:10:54 devstack cinder-volume[86174]: INFO oslo_service.backend._eventlet.service [None req-bba2a677-4f9e-46e0-b160-6fb4b092d89c None None] Child 86389 exited with status 0 Sep 28 12:10:55 devstack cinder-volume[86740]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 12:10:55 devstack cinder-volume[86740]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 12:10:55 devstack cinder-volume[86740]: we strongly recommend against using it for new projects. Sep 28 12:10:55 devstack cinder-volume[86740]: If you are already using Eventlet, we recommend migrating to a different Sep 28 12:10:55 devstack cinder-volume[86740]: framework. For more detail see Sep 28 12:10:55 devstack cinder-volume[86740]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 12:10:55 devstack cinder-volume[86740]: import eventlet # noqa Sep 28 12:10:58 devstack cinder-volume[86740]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 12:10:58 devstack cinder-volume[86740]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 12:10:58 devstack cinder-volume[86740]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 12:10:59 devstack cinder-volume[86740]: INFO dbcounter [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Registered counter for database cinder Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86740) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG dbcounter [-] [86740] Writer thread running {{(pid=86740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:10:59 devstack cinder-volume[86740]: INFO cinder.rpc [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 12:10:59 devstack cinder-volume[86740]: INFO cinder.rpc [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86740) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:10:59 devstack cinder-volume[86740]: INFO cinder.volume.manager [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Determined volume DB was empty at startup. Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG cinder.volume.manager [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86740) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 12:10:59 devstack cinder-volume[86740]: WARNING stevedore.named [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 12:10:59 devstack cinder-volume[86740]: WARNING castellan.key_manager [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:10:59 devstack cinder-volume[86740]: WARNING cinder.keymgr.conf_key_mgr [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 12:10:59 devstack cinder-volume[86740]: INFO cinder.volume.manager [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_db.sqlalchemy.engines [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86740) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:10:59 devstack cinder-volume[86740]: INFO oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Starting 1 workers Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Started child 87048 {{(pid=86740) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Full set of CONF: {{(pid=86740) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] ******************************************************************************** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] Configuration options gathered from: {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] ================================================================================ {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] allow_availability_zone_fallback = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] allow_compression_on_image_upload = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] allowed_direct_url_schemes = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] api_rate_limit = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[87048]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] auth_strategy = keystone {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_availability_zone = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_host = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_stats_polling_interval = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backup_api_class = cinder.backup.api.API {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backup_name_template = backup-%s {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backup_use_same_host = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backup_use_temp_snapshot = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] chap_password = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] chap_username = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cinder_internal_tenant_project_id = 997274dba951457ea1bd2dc8dcf497fe {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cinder_internal_tenant_user_id = e71b069efad149c9a3aa7d5f303ce146 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cluster = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] compression_format = gzip {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] compute_api_class = cinder.compute.nova.API {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] config_dir = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] config_source = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] control_exchange = openstack {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] debug = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] default_availability_zone = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] default_group_type = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] default_volume_type = QuobyteHD {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] disk_geometry = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] driver_client_cert = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] driver_client_cert_key = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] driver_data_namespace = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] driver_ssl_cert_path = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] driver_ssl_cert_verify = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] driver_use_ssl = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] enable_new_services = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] enable_unsupported_driver = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] enabled_backends = ['QuobyteHD'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] enforce_multipath_for_image_xfer = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] filter_function = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_api_insecure = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_api_servers = ['http://192.168.122.186/image'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_api_ssl_compression = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_ca_certificates_file = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_catalog_info = image:glance:publicURL {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_certfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_keyfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_num_retries = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance_request_timeout = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] goodness_function = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] graceful_shutdown_timeout = 5 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] group_api_class = cinder.group.api.API {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] host = devstack {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_compress_on_upload = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_conversion_address_space_limit = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_conversion_cpu_limit = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_conversion_disable = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_introspection_address_space_limit = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_introspection_cpu_limit = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_upload_use_cinder_backend = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_upload_use_internal_tenant = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_volume_cache_enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_volume_cache_max_count = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] image_volume_cache_max_size_gb = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] init_host_max_objects_retrieval = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] instance_format = [instance: %(uuid)s] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] iscsi_target_flags = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] iscsi_write_cache = on {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] iser_helper = tgtadm {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] iser_ip_address = 192.168.122.186 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] iser_port = 3260 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] log_color = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] log_config_append = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] log_dir = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] log_file = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] log_options = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] log_rotate_interval = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] log_rotate_interval_type = days {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] log_rotation_type = none {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] max_age = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] max_logfile_count = 30 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] max_logfile_size_mb = 200 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] max_over_subscription_ratio = 20.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] message_reap_interval = 86400 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] message_ttl = 2592000 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] migration_create_volume_timeout_secs = 300 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] monkey_patch = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] monkey_patch_modules = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] my_ip = 192.168.122.186 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] no_snapshot_gb_quota = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] num_iser_scan_tries = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] num_shell_tries = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] num_volume_device_scan_tries = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] nvmeof_conn_info_version = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] nvmet_ns_id = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] nvmet_port_id = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] osapi_max_limit = 1000 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] osapi_volume_ext_list = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] osapi_volume_listen_port = 8776 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] osapi_volume_use_ssl = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] osapi_volume_workers = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] per_volume_size_limit = -1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87048) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] periodic_fuzzy_delay = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] periodic_interval = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] public_endpoint = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] publish_errors = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] quota_backup_gigabytes = 1000 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] quota_backups = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] quota_gigabytes = 1000 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] quota_groups = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] quota_snapshots = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] quota_volumes = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] rate_limit_burst = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] rate_limit_except_level = CRITICAL {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] rate_limit_interval = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] reinit_driver_count = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] replication_device = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] report_discard_supported = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] report_interval = 120 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] reservation_clean_interval = 86400 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] reservation_expire = 86400 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] reserved_image_namespaces = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] reserved_percentage = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] rpc_response_timeout = 120 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] run_external_periodic_tasks = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] scst_target_driver = iscsi {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] scst_target_iqn_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_down_time = 720 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] shell_completion = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] snapshot_name_template = snapshot-%s {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] split_loggers = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] state_path = /opt/stack/data/cinder {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] storage_availability_zone = nova {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] storage_protocol = iSCSI {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] syslog_log_facility = LOG_USER {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] target_helper = lioadm {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] target_ip_address = 192.168.122.186 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] target_port = 3260 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] target_protocol = iscsi {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] target_secondary_ip_addresses = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] trace_flags = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] transport_url = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] until_refresh = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] use_chap_auth = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] use_default_quota_class = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] use_journal = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] use_json = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] use_multipath_for_image_xfer = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] use_stderr = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] use_syslog = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] verify_glance_signatures = enabled {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_api_class = cinder.volume.api.API {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_backend_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_clear = zero {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_clear_ionice = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_clear_size = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_copy_bps_limit = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_dd_blocksize = 1M {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_name_template = volume-%s {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_service_inithost_offload = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volume_usage_audit_period = month {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] zoning_mode = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_concurrency.disable_process_locking = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.auth_section = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.auth_type = password {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.auth_version = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.cache = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.certfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.include_service_catalog = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.insecure = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.interface = public {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.keyfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_password = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcache_username = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.region_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.service_type = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.186/identity {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.backend = dogpile.cache.null {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.backend_argument = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.backend_expiration_time = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.config_prefix = cache.oslo {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.debug_cache_backend = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.enable_retry_client = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.enable_socket_keepalive = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.expiration_time = 600 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87048) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.quobyte [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.hashclient_retry_attempts = 2 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.quobyte [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.memcache_dead_retry = 300 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.memcache_pool_maxsize = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Running cmd (subprocess): mount.quobyte {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.memcache_sasl_enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.password = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.proxies = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.redis_db = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.redis_server = localhost:6379 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.retry_attempts = 2 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.retry_delay = 0.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.socket_keepalive_count = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.socket_keepalive_idle = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.socket_keepalive_interval = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.socket_timeout = 1.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.tls_allowed_ciphers = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.tls_cafile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.tls_certfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.tls_enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.tls_keyfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cache.username = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] coordination.backend_url = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.asyncio_connection = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.asyncio_slave_connection = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.backend = sqlalchemy {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.connection = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.connection_debug = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.connection_parameters = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.connection_recycle_time = 3600 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.connection_trace = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.db_inc_retry_interval = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.db_max_retries = 20 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.db_max_retry_interval = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.db_retry_interval = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.max_overflow = 50 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.max_pool_size = 5 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.max_retries = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.mysql_wsrep_sync_wait = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.pool_timeout = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.retry_interval = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.slave_connection = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.sqlite_synchronous = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.synchronous_reader = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] database.use_db_reconnect = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_tracing.insecure = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.connection_string = messaging:// {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.es_doc_type = notification {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.es_scroll_size = 10000 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.es_scroll_time = 2m {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.filter_error_trace = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.hmac_keys = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.sentinel_service_name = mymaster {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.socket_timeout = 0.1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.trace_requests = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler.trace_sqlalchemy = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler_jaeger.process_tags = {} {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler_jaeger.service_name_prefix = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] profiler_otlp.service_name_prefix = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.enforce_new_defaults = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.policy_default_rule = default {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.policy_file = policy.yaml {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] privsep_osbrick.group = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] privsep_osbrick.helper_command = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] privsep_osbrick.user = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cinder_sys_admin.group = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cinder_sys_admin.helper_command = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] cinder_sys_admin.user = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.auth_section = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.auth_type = password {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.cafile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.certfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.collect_timing = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.insecure = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.keyfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.send_service_user_token = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.split_loggers = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.timeout = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.tls_ciphers = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] service_user.tls_min_version = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.auth_section = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.auth_type = password {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.certfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.collect_timing = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.insecure = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.keyfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.region_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.split_loggers = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.timeout = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.tls_ciphers = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] glance.tls_min_version = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.backend_availability_zone = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.chap_password = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.chap_username = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.disk_geometry = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.driver_client_cert = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.driver_client_cert_key = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.driver_data_namespace = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.driver_use_ssl = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.extra_capabilities = {} {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.filter_function = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.goodness_function = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.iscsi_target_flags = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.iscsi_write_cache = on {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.iser_helper = tgtadm {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.iser_ip_address = 192.168.122.186 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.iser_port = 3260 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_host = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_login = admin {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_mount_options = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_password = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_private_key = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_share_path = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.num_shell_tries = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.quobyte_volume_url = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.replication_device = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.report_discard_supported = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.reserved_percentage = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.target_helper = tgtadm {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.target_ip_address = 192.168.122.186 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.target_port = 3260 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.target_protocol = iscsi {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.trace_flags = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.unique_fqdn_network = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.use_chap_auth = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.volume_backend_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.volume_clear = zero {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.volume_clear_ionice = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack quobyte-client[87057]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.volume_clear_size = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack quobyte-client[87057]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_reports.file_event_handler = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_reports.log_dir = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.backend_availability_zone = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.backend_host = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.chap_password = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.chap_username = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.chiscsi_conf = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.disk_geometry = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.driver_client_cert = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.driver_data_namespace = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.driver_use_ssl = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.extra_capabilities = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.filter_function = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.goodness_function = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.iser_helper = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.iser_ip_address = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.iser_port = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.iser_target_prefix = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_host = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_login = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_mount_options = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_password = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_private_key = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_share_path = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_ssh_port = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.num_shell_tries = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.nvmet_port_id = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.replication_device = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.report_discard_supported = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.reserved_percentage = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.scst_target_driver = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.storage_protocol = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.target_helper = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.target_ip_address = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.target_port = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.target_prefix = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.target_protocol = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.trace_flags = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.use_chap_auth = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:10:59 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.volume_clear = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.volume_clear_size = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] QuobyteHD.volumes_dir = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack sudo[87058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.ssl = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_notifications.driver = [] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_notifications.retry = -1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] key_manager.fixed_key = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.barbican_api_version = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.barbican_endpoint = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.barbican_endpoint_type = public {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.barbican_region_name = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.cafile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.certfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.collect_timing = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.insecure = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.keyfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.number_of_retries = 60 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.retry_delay = 1 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.send_service_user_token = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.split_loggers = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.timeout = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.tls_ciphers = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.tls_min_version = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.verify_ssl = True {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican.verify_ssl_path = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.auth_section = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.auth_type = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.cafile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.certfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.collect_timing = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.insecure = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.keyfile = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.split_loggers = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.timeout = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.tls_ciphers = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] barbican_service_user.tls_min_version = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.approle_role_id = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.approle_secret_id = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.auth_method = approle {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.auth_path = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.kv_mountpoint = secret {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.kv_path = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.kv_version = 2 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.namespace = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.root_token_id = **** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.ssl_ca_crt_file = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.timeout = 60.0 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.token_file = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.token_role = None {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.use_ssl = False {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 12:11:00 devstack cinder-volume[86740]: DEBUG oslo_service.backend._eventlet.service [None req-6cd71d3b-5937-4e39-b851-8aa6b744db82 None None] ******************************************************************************** {{(pid=86740) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 12:11:00 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.256s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:00 devstack cinder-volume[87048]: INFO cinder.volume.driver [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.volume.driver [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2088623046875, 'free_capacity_gb': 1775.2088623046875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87048) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:886}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_db.sqlalchemy.engines [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87048) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writer thread running {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.db.api [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Building query based on filter {{(pid=87048) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87048) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:00 devstack cinder-volume[87048]: INFO cinder.keymgr.migration [None req-c76e3d27-2a8a-4621-b4a1-5ff7a6872ab6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 12:11:00 devstack sudo[87072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:11:00 devstack sudo[87072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:00 devstack sudo[87072]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.257s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:11:00 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Driver initialization completed successfully. Sep 28 12:11:00 devstack cinder-volume[87048]: INFO cinder.manager [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Initiating service 3 cleanup Sep 28 12:11:00 devstack cinder-volume[87048]: INFO cinder.manager [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Service 3 cleanup completed. Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.service [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Creating RPC server for service cinder-volume {{(pid=87048) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.service [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87048) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 12:11:00 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:11:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:11:00 devstack sudo[87088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:11:00 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:11:01 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root Sep 28 12:11:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.264s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:11:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-50ce624d-ddf5-40cd-8979-27045299f089 None None] Driver post RPC initialization completed successfully. Sep 28 12:11:09 devstack cinder-volume[86740]: DEBUG dbcounter [-] [86740] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:11:10 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:11:11 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=3 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:11:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:11:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 6 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:11:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Flow 'volume_create_manager' (b52e1860-9576-4316-bb06-c254f03089cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef5f0e0-826c-455d-9d7c-40671838611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ef5f0e0-826c-455d-9d7c-40671838611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1042499915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e936b7-b119-4e00-894d-6b2f1b8e32d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7348e1ab4dc4ec397b880b22a7999b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:05Z,use_quota=True,user_id='eb1819f2c3fd48fa8e8e8dcf611fc440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41acf93f-d863-40ed-9957-e0dc31bf1291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41acf93f-d863-40ed-9957-e0dc31bf1291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeaa746-65eb-427a-ac02-d2dbda57d384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eeaa746-65eb-427a-ac02-d2dbda57d384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e936b7-b119-4e00-894d-6b2f1b8e32d1', 'volume_name': 'volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cba82c0-276b-4f6b-beeb-69ceb883fcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cba82c0-276b-4f6b-beeb-69ceb883fcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51155fd4-ebe6-4da4-9988-52e3b20b2f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Volume 15e936b7-b119-4e00-894d-6b2f1b8e32d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1', 'volume_size': 1} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1042499915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e936b7-b119-4e00-894d-6b2f1b8e32d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7348e1ab4dc4ec397b880b22a7999b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:05Z,use_quota=True,user_id='eb1819f2c3fd48fa8e8e8dcf611fc440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Creating volume 15e936b7-b119-4e00-894d-6b2f1b8e32d1 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:12:05 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:12:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:05 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 1073741824 Sep 28 12:12:05 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:06 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 1073741824" returned: 0 in 1.070s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:06 devstack sudo[87734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 Sep 28 12:12:06 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:07 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1" returned: 0 in 0.440s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:12:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51155fd4-ebe6-4da4-9988-52e3b20b2f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63124fe0-0086-425e-96f9-b543c2e45ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:07 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Volume volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 (15e936b7-b119-4e00-894d-6b2f1b8e32d1): created successfully Sep 28 12:12:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63124fe0-0086-425e-96f9-b543c2e45ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Flow 'volume_create_manager' (b52e1860-9576-4316-bb06-c254f03089cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:07 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ac0f17f6-3c88-4188-a895-206c759f21da tempest-TaggedAttachmentsTest-13947945 None] Created volume successfully. Sep 28 12:12:17 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:12:17 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Flow 'volume_create_manager' (c68b71bd-3879-4743-ac29-a9452f6c3c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47236fe-0bde-4ed8-ab39-d27211fca19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47236fe-0bde-4ed8-ab39-d27211fca19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1353182968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c22eb97-3225-4a25-810c-15b9c78fd082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feca4602a3f242258f384836224ad745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:27Z,use_quota=True,user_id='d950e575035f448189c168e44c08dcac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69cbecd-d69b-4ad0-b7a5-20ccdd634c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e69cbecd-d69b-4ad0-b7a5-20ccdd634c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c329b41-055d-4870-b850-8d0579da4b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c329b41-055d-4870-b850-8d0579da4b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c22eb97-3225-4a25-810c-15b9c78fd082', 'volume_name': 'volume-8c22eb97-3225-4a25-810c-15b9c78fd082', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2993ad-55fc-4619-bd00-49e1f2f6d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b2993ad-55fc-4619-bd00-49e1f2f6d593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f6e370-8a9b-40cb-a389-c4b079fe70c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:27 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Volume 8c22eb97-3225-4a25-810c-15b9c78fd082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c22eb97-3225-4a25-810c-15b9c78fd082', 'volume_size': 1} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1353182968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c22eb97-3225-4a25-810c-15b9c78fd082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='feca4602a3f242258f384836224ad745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:27Z,use_quota=True,user_id='d950e575035f448189c168e44c08dcac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Creating volume 8c22eb97-3225-4a25-810c-15b9c78fd082 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:12:27 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:12:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:27 devstack sudo[88113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082 1073741824 Sep 28 12:12:27 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:28 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082 1073741824" returned: 0 in 1.111s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:28 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082 Sep 28 12:12:28 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:29 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082" returned: 0 in 0.828s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] <== create_volume: return (2062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:12:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:29 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5f6e370-8a9b-40cb-a389-c4b079fe70c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c22eb97-3225-4a25-810c-15b9c78fd082', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:29 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e0bd74-2f1a-497a-a81d-9c100abf7421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:29 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Volume volume-8c22eb97-3225-4a25-810c-15b9c78fd082 (8c22eb97-3225-4a25-810c-15b9c78fd082): created successfully Sep 28 12:12:29 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0e0bd74-2f1a-497a-a81d-9c100abf7421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:29 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Flow 'volume_create_manager' (c68b71bd-3879-4743-ac29-a9452f6c3c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c5d85b28-2127-422b-87f6-0695691ea1ab tempest-VolumesAdminNegativeTest-1181789135 None] Created volume successfully. Sep 28 12:12:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Acquiring lock "cinder-8c22eb97-3225-4a25-810c-15b9c78fd082-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Lock "cinder-8c22eb97-3225-4a25-810c-15b9c78fd082-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Acquiring lock "cinder-quobyte-8c22eb97-3225-4a25-810c-15b9c78fd082" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Lock "cinder-quobyte-8c22eb97-3225-4a25-810c-15b9c78fd082" acquired by "delete_volume" :: waited 0.046s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:31 devstack cinder-volume[87048]: INFO oslo.privsep.daemon [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp6mweqph1/privsep.sock'] Sep 28 12:12:31 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp6mweqph1/privsep.sock Sep 28 12:12:31 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:33 devstack cinder-volume[87048]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 12:12:33 devstack cinder-volume[87048]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 12:12:33 devstack cinder-volume[87048]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 12:12:33 devstack cinder-volume[87048]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 12:12:33 devstack cinder-volume[87048]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 12:12:33 devstack cinder-volume[87048]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 12:12:33 devstack cinder-volume[87048]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 12:12:33 devstack cinder-volume[87048]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 12:12:33 devstack cinder-volume[87048]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 12:12:33 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:33 devstack cinder-volume[87048]: INFO oslo.privsep.daemon [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Spawned new privsep daemon via rootwrap Sep 28 12:12:33 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Accepted privsep connection to /tmp/tmp6mweqph1/privsep.sock {{(pid=87048) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 12:12:33 devstack cinder-volume[87048]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 12:12:33 devstack cinder-volume[87048]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 12:12:33 devstack cinder-volume[87048]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 12:12:33 devstack cinder-volume[87048]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88192 Sep 28 12:12:33 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eb8532-e023-401c-b679-290aba3e056b]: (2,) {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:12:33 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b05407-01c0-4889-afef-989eb0ce4a5b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:12:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:34 devstack sudo[88198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082 Sep 28 12:12:34 devstack sudo[88198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:34 devstack sudo[88198]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082" returned: 0 in 0.671s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:34 devstack sudo[88228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082 Sep 28 12:12:34 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:34 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c22eb97-3225-4a25-810c-15b9c78fd082" returned: 0 in 0.483s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Lock "cinder-quobyte-8c22eb97-3225-4a25-810c-15b9c78fd082" released by "delete_volume" :: held 3.424s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:35 devstack cinder-volume[87048]: WARNING cinder.quota [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:12:35 devstack cinder-volume[87048]: WARNING cinder.quota [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:12:35 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Created reservations ['e589b5ea-c8c8-40df-ae5f-a1df1a7898cb', '816cb134-31f7-4d97-b6d1-de3acae68e0c', '2e8b58f3-cac7-4663-9914-88827ca35337', '90e517bb-1fe0-4f80-8459-afcb25e4b8c2'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:12:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:35 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:12:35 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:35 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.506s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:36 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:12:36 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Deleted volume successfully. Sep 28 12:12:36 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a299abd3-1b88-4a8d-b956-169b7b120197 tempest-VolumesAdminNegativeTest-1181789135 None] Lock "cinder-8c22eb97-3225-4a25-810c-15b9c78fd082-delete_volume" released by "delete_volume" :: held 4.705s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:38 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:12:38 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:38 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.377s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 8 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:12:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Flow 'volume_create_manager' (a8cdabec-4543-45ca-a8c9-bd7d37d4ba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542f2907-3558-41a3-ab1a-c6e49684391f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542f2907-3558-41a3-ab1a-c6e49684391f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-505284038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e4c91d-1ae3-41a7-b578-7dccf109ad12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b23f7df6d343a2acb8499d3b1caeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:45Z,use_quota=True,user_id='9c03c7fbefc34c22a9da58834098281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37681012-7f95-4bbc-be68-62e6326eb173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37681012-7f95-4bbc-be68-62e6326eb173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4302e7-496f-45ae-8511-37ff5a8e013d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a4302e7-496f-45ae-8511-37ff5a8e013d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83e4c91d-1ae3-41a7-b578-7dccf109ad12', 'volume_name': 'volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4646b738-1646-4a84-9297-627173d16cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4646b738-1646-4a84-9297-627173d16cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2412e1b7-238e-4794-8de3-f441bffd4a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:45 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Volume 83e4c91d-1ae3-41a7-b578-7dccf109ad12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12', 'volume_size': 1} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-505284038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83e4c91d-1ae3-41a7-b578-7dccf109ad12,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b23f7df6d343a2acb8499d3b1caeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:45Z,use_quota=True,user_id='9c03c7fbefc34c22a9da58834098281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Creating volume 83e4c91d-1ae3-41a7-b578-7dccf109ad12 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:12:45 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:45 devstack sudo[88303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 1073741824 Sep 28 12:12:45 devstack sudo[88303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:45 devstack sudo[88303]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 1073741824" returned: 0 in 0.605s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:46 devstack sudo[88309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 Sep 28 12:12:46 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:46 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12" returned: 0 in 0.340s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:12:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2412e1b7-238e-4794-8de3-f441bffd4a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e16d12-759d-4e0a-b78d-7a3ce4ada903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:46 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Volume volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 (83e4c91d-1ae3-41a7-b578-7dccf109ad12): created successfully Sep 28 12:12:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e16d12-759d-4e0a-b78d-7a3ce4ada903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Flow 'volume_create_manager' (a8cdabec-4543-45ca-a8c9-bd7d37d4ba46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-fa30aad8-da9b-4ea5-a9ad-499f3045ac95 tempest-VolumesTestJSON-1274003059 None] Created volume successfully. Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Flow 'volume_create_manager' (511d6a3a-b963-409d-bddc-704617e544a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1caaae2e-c4ed-4f73-b2b7-9c10e6b18f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1caaae2e-c4ed-4f73-b2b7-9c10e6b18f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1576625024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f820948c-bc65-4192-9e2b-9ebd9a4fbd63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b23f7df6d343a2acb8499d3b1caeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:48Z,use_quota=True,user_id='9c03c7fbefc34c22a9da58834098281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4498f6ba-96b8-4640-95b7-24731b5144bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4498f6ba-96b8-4640-95b7-24731b5144bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedf1106-7342-4d80-bcda-3e3bb478c875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedf1106-7342-4d80-bcda-3e3bb478c875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f820948c-bc65-4192-9e2b-9ebd9a4fbd63', 'volume_name': 'volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b30c55d-c54e-41c8-bb35-1faf5e775106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b30c55d-c54e-41c8-bb35-1faf5e775106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23eb280-4800-4716-8036-4f70687bf219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:48 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Volume f820948c-bc65-4192-9e2b-9ebd9a4fbd63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63', 'volume_size': 1} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1576625024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f820948c-bc65-4192-9e2b-9ebd9a4fbd63,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b23f7df6d343a2acb8499d3b1caeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:48Z,use_quota=True,user_id='9c03c7fbefc34c22a9da58834098281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Creating volume f820948c-bc65-4192-9e2b-9ebd9a4fbd63 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:12:48 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:12:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:48 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 1073741824 Sep 28 12:12:48 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:49 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 1073741824" returned: 0 in 0.631s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:49 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 Sep 28 12:12:49 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:49 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63" returned: 0 in 0.470s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:12:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23eb280-4800-4716-8036-4f70687bf219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6168c8-53f4-4dff-8668-014dd0b770a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:49 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Volume volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 (f820948c-bc65-4192-9e2b-9ebd9a4fbd63): created successfully Sep 28 12:12:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6168c8-53f4-4dff-8668-014dd0b770a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Flow 'volume_create_manager' (511d6a3a-b963-409d-bddc-704617e544a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-12a4c7e6-3ea5-4fe9-ac2f-a86035ba7769 tempest-VolumesTestJSON-1274003059 None] Created volume successfully. Sep 28 12:12:50 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:12:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Flow 'volume_create_manager' (66b67266-4031-4f6b-8076-11d97dcd6bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a83f35-eb69-45d1-aa34-d8db149e1455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a83f35-eb69-45d1-aa34-d8db149e1455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1576130429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4866d7-ca08-4ac0-9a13-f3a618e624c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d76f4883b504584b4f375d9f27d732b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:51Z,use_quota=True,user_id='09ea06dcda7d486abb4601b9b1133ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4067c571-b6e3-40b5-906b-e6b36d81c8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4067c571-b6e3-40b5-906b-e6b36d81c8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4518696-a16a-4c73-b535-8ed7bedd232d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4518696-a16a-4c73-b535-8ed7bedd232d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4866d7-ca08-4ac0-9a13-f3a618e624c9', 'volume_name': 'volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43d4a6e-e3b1-4359-97db-b79103859083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f43d4a6e-e3b1-4359-97db-b79103859083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de834906-5193-43ec-b194-664573969cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Volume 0e4866d7-ca08-4ac0-9a13-f3a618e624c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9', 'volume_size': 1} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1576130429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4866d7-ca08-4ac0-9a13-f3a618e624c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d76f4883b504584b4f375d9f27d732b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:51Z,use_quota=True,user_id='09ea06dcda7d486abb4601b9b1133ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Creating volume 0e4866d7-ca08-4ac0-9a13-f3a618e624c9 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:12:51 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:51 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 1073741824 Sep 28 12:12:51 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Flow 'volume_create_manager' (853f121d-3665-4706-b1e6-8baf398c0eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e37ebcc-17da-4bc6-bd16-341911d5be5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e37ebcc-17da-4bc6-bd16-341911d5be5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425905523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9994f228-0422-4d57-b162-5edc0fc40506,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b23f7df6d343a2acb8499d3b1caeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:51Z,use_quota=True,user_id='9c03c7fbefc34c22a9da58834098281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10d9c66-9f7c-4d69-ac80-39020b6aa8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d10d9c66-9f7c-4d69-ac80-39020b6aa8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b1f8ee-e37a-417b-82a4-8b44bcf8d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b1f8ee-e37a-417b-82a4-8b44bcf8d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9994f228-0422-4d57-b162-5edc0fc40506', 'volume_name': 'volume-9994f228-0422-4d57-b162-5edc0fc40506', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31badde-1f00-4634-9fc1-e1a3fdb3f97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31badde-1f00-4634-9fc1-e1a3fdb3f97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a846ef9d-d8e4-4b6a-976b-ca56a1613151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:51 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Volume 9994f228-0422-4d57-b162-5edc0fc40506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9994f228-0422-4d57-b162-5edc0fc40506', 'volume_size': 1} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:51 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 1073741824" returned: 0 in 0.617s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:51 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 Sep 28 12:12:51 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:52 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9" returned: 0 in 0.258s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-425905523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9994f228-0422-4d57-b162-5edc0fc40506,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='49b23f7df6d343a2acb8499d3b1caeb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:12:51Z,use_quota=True,user_id='9c03c7fbefc34c22a9da58834098281a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Creating volume 9994f228-0422-4d57-b162-5edc0fc40506 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:12:52 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de834906-5193-43ec-b194-664573969cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:52 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506 1073741824 Sep 28 12:12:52 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9907ab7-ac83-436a-9c92-24e44dcd554c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:52 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Volume volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 (0e4866d7-ca08-4ac0-9a13-f3a618e624c9): created successfully Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9907ab7-ac83-436a-9c92-24e44dcd554c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Flow 'volume_create_manager' (66b67266-4031-4f6b-8076-11d97dcd6bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-95b62e44-7164-4f7f-9231-fea1740fb153 tempest-ServerActionsTestOtherA-484120818 None] Created volume successfully. Sep 28 12:12:52 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506 1073741824" returned: 0 in 0.632s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:52 devstack sudo[88397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506 Sep 28 12:12:52 devstack sudo[88397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:53 devstack sudo[88397]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506" returned: 0 in 0.272s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:12:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a846ef9d-d8e4-4b6a-976b-ca56a1613151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9994f228-0422-4d57-b162-5edc0fc40506', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fd7387-8bd3-48c5-912d-ab460de19ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:12:53 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Volume volume-9994f228-0422-4d57-b162-5edc0fc40506 (9994f228-0422-4d57-b162-5edc0fc40506): created successfully Sep 28 12:12:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fd7387-8bd3-48c5-912d-ab460de19ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:12:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Flow 'volume_create_manager' (853f121d-3665-4706-b1e6-8baf398c0eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:12:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-154a9456-d7d3-42d8-8f79-35dbe17187f9 tempest-VolumesTestJSON-1274003059 None] Created volume successfully. Sep 28 12:12:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "cinder-9994f228-0422-4d57-b162-5edc0fc40506-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Lock "cinder-9994f228-0422-4d57-b162-5edc0fc40506-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "cinder-quobyte-9994f228-0422-4d57-b162-5edc0fc40506" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Lock "cinder-quobyte-9994f228-0422-4d57-b162-5edc0fc40506" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:54 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[105e26f2-60bd-4d02-b06b-62ea324b21b0]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:12:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:54 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506 Sep 28 12:12:54 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:55 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506" returned: 0 in 0.516s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:55 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506 Sep 28 12:12:55 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:55 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9994f228-0422-4d57-b162-5edc0fc40506" returned: 0 in 0.311s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Lock "cinder-quobyte-9994f228-0422-4d57-b162-5edc0fc40506" released by "delete_volume" :: held 0.892s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Created reservations ['d65e433f-9155-4ea1-ac6f-007026a480ad', '75d3386b-042a-4577-9122-9ce199884e1b', 'a49e24f6-f5ae-4043-9c56-ae632e2b0dcb', '2a4e5619-d0e3-459c-8214-17e16ccac24c'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:56 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:12:56 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:56 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.346s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:56 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:12:56 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Deleted volume successfully. Sep 28 12:12:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b82acc5-6c65-4a13-b419-906b36172f31 tempest-VolumesTestJSON-1274003059 None] Lock "cinder-9994f228-0422-4d57-b162-5edc0fc40506-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Acquiring lock "cinder-f820948c-bc65-4192-9e2b-9ebd9a4fbd63-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Lock "cinder-f820948c-bc65-4192-9e2b-9ebd9a4fbd63-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Acquiring lock "cinder-quobyte-f820948c-bc65-4192-9e2b-9ebd9a4fbd63" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Lock "cinder-quobyte-f820948c-bc65-4192-9e2b-9ebd9a4fbd63" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:57 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2832f220-ff73-41d0-ac93-bab989cf7ade]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:12:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:57 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 Sep 28 12:12:57 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:57 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63" returned: 0 in 0.596s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:57 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63 Sep 28 12:12:57 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:58 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f820948c-bc65-4192-9e2b-9ebd9a4fbd63" returned: 0 in 0.438s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Lock "cinder-quobyte-f820948c-bc65-4192-9e2b-9ebd9a4fbd63" released by "delete_volume" :: held 1.153s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Created reservations ['d2a338fe-74e1-4cfe-9fdf-a6d47af5ef01', 'b4944d8d-8b59-49cf-951b-f9565cae2b59', '16122589-f352-42b3-9c45-e1f356f21fba', '219a0817-ca84-4d8c-9774-85b266207ba3'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:58 devstack sudo[88470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:12:58 devstack sudo[88470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:12:58 devstack sudo[88470]: pam_unix(sudo:session): session closed for user root Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.300s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:12:58 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Deleted volume successfully. Sep 28 12:12:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c05f13f2-9684-4b24-9c9a-4f2ca9c193da tempest-VolumesTestJSON-1274003059 None] Lock "cinder-f820948c-bc65-4192-9e2b-9ebd9a4fbd63-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:12:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "cinder-83e4c91d-1ae3-41a7-b578-7dccf109ad12-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Lock "cinder-83e4c91d-1ae3-41a7-b578-7dccf109ad12-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "cinder-quobyte-83e4c91d-1ae3-41a7-b578-7dccf109ad12" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:12:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Lock "cinder-quobyte-83e4c91d-1ae3-41a7-b578-7dccf109ad12" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:12:59 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd640e7-66c2-4871-829f-8162c9b20a27]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:12:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:12:59 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 Sep 28 12:12:59 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:00 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12" returned: 0 in 0.486s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:00 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12 Sep 28 12:13:00 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:00 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-83e4c91d-1ae3-41a7-b578-7dccf109ad12" returned: 0 in 0.538s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Lock "cinder-quobyte-83e4c91d-1ae3-41a7-b578-7dccf109ad12" released by "delete_volume" :: held 1.100s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Created reservations ['4a33bbe4-75fc-4e9f-a299-abd24761b8d6', 'd23275fe-3425-4c9d-abcc-ae977e83aeb5', 'b5db6553-31c7-494f-95d0-5d7546252a8e', 'd9d94251-ccc4-473c-8c6f-c7f1f87244f7'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:00 devstack sudo[88518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:13:00 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:01 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.451s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:01 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Deleted volume successfully. Sep 28 12:13:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-76d29af3-0c4d-4efa-a7a5-50778c4aa342 tempest-VolumesTestJSON-1274003059 None] Lock "cinder-83e4c91d-1ae3-41a7-b578-7dccf109ad12-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:11 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=29,cinder:UPDATE=48,cinder:DELETE=3,cinder:INSERT=8 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:13:11 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=47,cinder:SELECT=32,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:13:13 devstack cinder-volume[87048]: WARNING py.warnings [req-1ffc06e2-1676-44cf-8d43-6e1611298fca req-226d63fa-eb84-46d4-921e-1443837fddf0 tempest-TaggedAttachmentsTest-13947945 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 28 12:13:13 devstack cinder-volume[87048]: .first() Sep 28 12:13:13 devstack cinder-volume[87048]: Sep 28 12:13:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-1ffc06e2-1676-44cf-8d43-6e1611298fca req-226d63fa-eb84-46d4-921e-1443837fddf0 tempest-TaggedAttachmentsTest-13947945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-1ffc06e2-1676-44cf-8d43-6e1611298fca req-226d63fa-eb84-46d4-921e-1443837fddf0 tempest-TaggedAttachmentsTest-13947945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-1ffc06e2-1676-44cf-8d43-6e1611298fca req-226d63fa-eb84-46d4-921e-1443837fddf0 tempest-TaggedAttachmentsTest-13947945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-1ffc06e2-1676-44cf-8d43-6e1611298fca req-226d63fa-eb84-46d4-921e-1443837fddf0 tempest-TaggedAttachmentsTest-13947945 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0bf7977-783b-4e08-8bdc-2edc2743662c', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:13:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-1ffc06e2-1676-44cf-8d43-6e1611298fca req-226d63fa-eb84-46d4-921e-1443837fddf0 tempest-TaggedAttachmentsTest-13947945 None] attachment_update completed successfully. Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Flow 'volume_create_manager' (347bb3e9-fc0e-4b4e-b4bb-9960f5c48268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6383a6e0-8853-4ec4-b8bf-1300ec60145b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6383a6e0-8853-4ec4-b8bf-1300ec60145b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-163682271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a5d268-fc6b-431b-8f51-f7ad03501eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60990dd8610b46a3b1b40a46951c3e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:17Z,use_quota=True,user_id='925bf0c195254879ad1c585ed5aee839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1838f8f-2898-4bc6-aaef-108b2afefb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1838f8f-2898-4bc6-aaef-108b2afefb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6dd068-3b5c-4a65-bf7e-898304b62683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6dd068-3b5c-4a65-bf7e-898304b62683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a5d268-fc6b-431b-8f51-f7ad03501eb3', 'volume_name': 'volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d817594e-7c1d-4b6c-ad33-af6f02a50b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d817594e-7c1d-4b6c-ad33-af6f02a50b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a661fb28-86bd-4e24-8aa0-e66ee7d5a695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:17 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3', 'volume_size': 1} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-163682271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a5d268-fc6b-431b-8f51-f7ad03501eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60990dd8610b46a3b1b40a46951c3e1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:17Z,use_quota=True,user_id='925bf0c195254879ad1c585ed5aee839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Creating volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:13:17 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:13:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:17 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 1073741824 Sep 28 12:13:17 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:18 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 1073741824" returned: 0 in 0.560s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:18 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-9493f0cd-58e3-459e-a853-48a13a6b6362 req-e183bd66-806b-4a71-9a46-a302598e1b82 tempest-TaggedAttachmentsTest-13947945 None] Terminate volume connection completed successfully. Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-9493f0cd-58e3-459e-a853-48a13a6b6362 req-e183bd66-806b-4a71-9a46-a302598e1b82 tempest-TaggedAttachmentsTest-13947945 None] Deleting attachment f0bf7977-783b-4e08-8bdc-2edc2743662c. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:18 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 Sep 28 12:13:18 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:18 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3" returned: 0 in 0.280s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a661fb28-86bd-4e24-8aa0-e66ee7d5a695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc681ebf-d11c-487f-91cb-645ea7be141d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Volume volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 (99a5d268-fc6b-431b-8f51-f7ad03501eb3): created successfully Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc681ebf-d11c-487f-91cb-645ea7be141d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Flow 'volume_create_manager' (347bb3e9-fc0e-4b4e-b4bb-9960f5c48268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:18 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ac7bf203-ca12-459c-95c4-ddec124fae91 tempest-SnapshotsActionsTest-1673486302 None] Created volume successfully. Sep 28 12:13:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Creating offline snapshot 53ba5d27-e357-4289-952a-241e0f4bc1b7 of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:13:19 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d60e07f-7559-45ef-9dcd-a228ac7e7752]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:19 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 Sep 28 12:13:19 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:20 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3" returned: 0 in 0.608s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:20 devstack sudo[89152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 1G Sep 28 12:13:20 devstack sudo[89152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:20 devstack sudo[89152]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 1G" returned: 0 in 0.563s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:20 devstack sudo[89163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:20 devstack sudo[89163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:21 devstack sudo[89163]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.355s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:21 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 is being set with open permissions: ugo+rw Sep 28 12:13:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:21 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:21 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:21 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.330s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:21 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.info Sep 28 12:13:21 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:21 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.info" returned: 0 in 0.305s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:21 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.info is being set with open permissions: ugo+rw Sep 28 12:13:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:22 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.info Sep 28 12:13:22 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:22 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.info" returned: 0 in 0.390s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.723s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a588f791-4781-4ef5-a6cd-c9dce77a2373 tempest-SnapshotsActionsTest-1673486302 None] Create snapshot completed successfully Sep 28 12:13:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Creating offline snapshot 581cf52b-a8f7-484b-9410-4d7e238cce5a of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:13:24 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1666e8-2264-465f-95fc-a8707a1cd87d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:24 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:24 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:24 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.478s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:24 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a 1G Sep 28 12:13:24 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:25 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a 1G" returned: 0 in 0.655s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:25 devstack sudo[89209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a Sep 28 12:13:25 devstack sudo[89209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:25 devstack sudo[89209]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a" returned: 0 in 0.449s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:25 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a is being set with open permissions: ugo+rw Sep 28 12:13:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:25 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a Sep 28 12:13:25 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:26 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.135s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:26 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9fe3a5fa-1a84-4b6c-b860-a5f7e7f73633 tempest-SnapshotsActionsTest-1673486302 None] Create snapshot completed successfully Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-581cf52b-a8f7-484b-9410-4d7e238cce5a-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-581cf52b-a8f7-484b-9410-4d7e238cce5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-quobyte-581cf52b-a8f7-484b-9410-4d7e238cce5a" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-581cf52b-a8f7-484b-9410-4d7e238cce5a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Deleting offline snapshot 581cf52b-a8f7-484b-9410-4d7e238cce5a of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] snapshot_file for this snap is: volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38e5209-083d-48e3-a10c-dab51187648d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:27 devstack sudo[89239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a Sep 28 12:13:27 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:28 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a" returned: 0 in 0.562s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[738380fc-0ce0-42ce-9b6c-1fcb43357025]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:28 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:28 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:28 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.605s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:28 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a Sep 28 12:13:28 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:29 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a" returned: 0 in 0.470s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:29 devstack sudo[89273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a Sep 28 12:13:29 devstack sudo[89273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:29 devstack sudo[89273]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.581cf52b-a8f7-484b-9410-4d7e238cce5a" returned: 0 in 0.321s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-581cf52b-a8f7-484b-9410-4d7e238cce5a" released by "_delete_snapshot" :: held 2.178s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" released by "delete_snapshot" :: held 2.222s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:29 devstack cinder-volume[87048]: WARNING cinder.quota [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:13:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Created reservations ['433f7204-e3f0-47dc-bd96-f0dfaac8b6b2', 'fbdd1b8e-2f01-403a-a861-c2aae2cc7225', 'e6f5170f-a57e-4d28-8f04-6c383a43efad', '30cf55e7-0137-42cf-9893-ab84167d77e6'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Delete snapshot completed successfully. Sep 28 12:13:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a653914-ca5a-4142-910c-1b4ba530ba94 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-581cf52b-a8f7-484b-9410-4d7e238cce5a-delete_snapshot" released by "delete_snapshot" :: held 2.458s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-dcf3e6c7-f4b5-4db0-8c35-384a575ad84b req-89bed093-ac7f-403c-9560-33027300e20f tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-dcf3e6c7-f4b5-4db0-8c35-384a575ad84b req-89bed093-ac7f-403c-9560-33027300e20f tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-dcf3e6c7-f4b5-4db0-8c35-384a575ad84b req-89bed093-ac7f-403c-9560-33027300e20f tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:30 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-dcf3e6c7-f4b5-4db0-8c35-384a575ad84b req-89bed093-ac7f-403c-9560-33027300e20f tempest-ServerActionsTestOtherA-484120818 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b90860e-e68b-400b-89bb-b83a3399c428', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:13:30 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-dcf3e6c7-f4b5-4db0-8c35-384a575ad84b req-89bed093-ac7f-403c-9560-33027300e20f tempest-ServerActionsTestOtherA-484120818 None] attachment_update completed successfully. Sep 28 12:13:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Creating offline snapshot f1a57665-be1c-4e3f-8afe-115aca17e2ba of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:13:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[00338109-a51e-40a1-8aa6-a40239e9a2fd]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:31 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:31 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:32 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.839s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:32 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba 1G Sep 28 12:13:32 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Acquiring lock "cinder-15e936b7-b119-4e00-894d-6b2f1b8e32d1-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Lock "cinder-15e936b7-b119-4e00-894d-6b2f1b8e32d1-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Acquiring lock "cinder-quobyte-15e936b7-b119-4e00-894d-6b2f1b8e32d1" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Lock "cinder-quobyte-15e936b7-b119-4e00-894d-6b2f1b8e32d1" acquired by "delete_volume" :: waited 0.036s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[805903a9-17b3-49f6-905c-ca2fffb712c2]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:32 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 Sep 28 12:13:32 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:32 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba 1G" returned: 0 in 0.777s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:32 devstack sudo[89789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba Sep 28 12:13:32 devstack sudo[89789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:33 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1" returned: 0 in 0.538s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:33 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1 Sep 28 12:13:33 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:33 devstack sudo[89789]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba" returned: 0 in 0.423s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:33 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba is being set with open permissions: ugo+rw Sep 28 12:13:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:33 devstack sudo[89816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba Sep 28 12:13:33 devstack sudo[89816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:33 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15e936b7-b119-4e00-894d-6b2f1b8e32d1" returned: 0 in 0.392s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Lock "cinder-quobyte-15e936b7-b119-4e00-894d-6b2f1b8e32d1" released by "delete_volume" :: held 1.006s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:33 devstack sudo[89816]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba" returned: 0 in 0.444s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.757s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f76cb9c7-fbab-4e69-b175-e4cad2ff1d87 tempest-SnapshotsActionsTest-1673486302 None] Create snapshot completed successfully Sep 28 12:13:33 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Created reservations ['be701c86-e383-482f-a53c-b399e82c7712', '95ece666-9af9-4594-a7a1-f3d8e0d6b6f9', 'c75d4b2a-dff2-4fab-965b-b46e26a1544c', 'a8025f29-55ae-484d-84f6-2fe9c74e4551'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:34 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:13:34 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:34 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.438s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Deleted volume successfully. Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-360eb3f4-268c-4f4e-9f17-3d1f26c7abe0 tempest-TaggedAttachmentsTest-13947945 None] Lock "cinder-15e936b7-b119-4e00-894d-6b2f1b8e32d1-delete_volume" released by "delete_volume" :: held 1.966s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-f1a57665-be1c-4e3f-8afe-115aca17e2ba-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-f1a57665-be1c-4e3f-8afe-115aca17e2ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-quobyte-f1a57665-be1c-4e3f-8afe-115aca17e2ba" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-f1a57665-be1c-4e3f-8afe-115aca17e2ba" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Deleting offline snapshot f1a57665-be1c-4e3f-8afe-115aca17e2ba of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] snapshot_file for this snap is: volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[208a6775-191f-433c-818f-c1ac9e0910c4]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:35 devstack sudo[89829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba Sep 28 12:13:35 devstack sudo[89829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:35 devstack sudo[89829]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba" returned: 0 in 0.547s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:35 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af12123-b367-4a83-82bc-45ec44f87872]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:35 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:35 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-82d71295-6b03-4b6d-80d9-332938670916 req-3b2da20b-b8dc-4332-9f46-8d4772fd5213 tempest-ServerActionsTestOtherA-484120818 None] Terminate volume connection completed successfully. Sep 28 12:13:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-82d71295-6b03-4b6d-80d9-332938670916 req-3b2da20b-b8dc-4332-9f46-8d4772fd5213 tempest-ServerActionsTestOtherA-484120818 None] Deleting attachment 5b90860e-e68b-400b-89bb-b83a3399c428. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:13:36 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.611s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:36 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba Sep 28 12:13:36 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:37 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba" returned: 0 in 1.052s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:37 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba Sep 28 12:13:37 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-82d71295-6b03-4b6d-80d9-332938670916 req-b2a84855-d75e-4453-9e7c-ee4b84f7f435 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-82d71295-6b03-4b6d-80d9-332938670916 req-b2a84855-d75e-4453-9e7c-ee4b84f7f435 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-82d71295-6b03-4b6d-80d9-332938670916 req-b2a84855-d75e-4453-9e7c-ee4b84f7f435 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:37 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.f1a57665-be1c-4e3f-8afe-115aca17e2ba" returned: 0 in 0.563s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-f1a57665-be1c-4e3f-8afe-115aca17e2ba" released by "_delete_snapshot" :: held 3.031s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" released by "delete_snapshot" :: held 3.084s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-82d71295-6b03-4b6d-80d9-332938670916 req-b2a84855-d75e-4453-9e7c-ee4b84f7f435 tempest-ServerActionsTestOtherA-484120818 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc61e41e-ca4b-428d-acdb-6cc40e9cb838', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:13:37 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Created reservations ['c66911fa-dc20-4efd-af98-753ab1b8ac27', '8c02d66d-0892-4b80-9212-448a54d2d174', 'e73473a3-9393-4f1f-9787-25bb8a460617', '49f8a1cc-0308-4171-a4d7-d3e6bc92d28f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-82d71295-6b03-4b6d-80d9-332938670916 req-b2a84855-d75e-4453-9e7c-ee4b84f7f435 tempest-ServerActionsTestOtherA-484120818 None] attachment_update completed successfully. Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:38 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:13:38 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Delete snapshot completed successfully. Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3ad2836e-9552-4fa4-bd9e-468a328b53fc tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-f1a57665-be1c-4e3f-8afe-115aca17e2ba-delete_snapshot" released by "delete_snapshot" :: held 3.479s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Flow 'volume_create_manager' (aa13e4bc-6588-46de-97d3-8e27e683869d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827256bc-6ead-4b79-9428-a9091b90c001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827256bc-6ead-4b79-9428-a9091b90c001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-385483625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9828fb73-4b19-45ba-bcc7-1b2d071a0329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552f9967f5fe42bd8a1b50943780fbd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:38Z,use_quota=True,user_id='7bc47a27c17d4e87aa996ba013012f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3972a273-005b-43b8-8146-da540cd8fee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3972a273-005b-43b8-8146-da540cd8fee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9033c41-edd1-420b-9d58-78371d606d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9033c41-edd1-420b-9d58-78371d606d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9828fb73-4b19-45ba-bcc7-1b2d071a0329', 'volume_name': 'volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec497989-3a9b-474b-9bed-77de259f9185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec497989-3a9b-474b-9bed-77de259f9185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d439407-903c-41fb-ae57-ef43deac6d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:38 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Volume 9828fb73-4b19-45ba-bcc7-1b2d071a0329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329', 'volume_size': 1} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-385483625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9828fb73-4b19-45ba-bcc7-1b2d071a0329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='552f9967f5fe42bd8a1b50943780fbd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:38Z,use_quota=True,user_id='7bc47a27c17d4e87aa996ba013012f20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Creating volume 9828fb73-4b19-45ba-bcc7-1b2d071a0329 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:13:38 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:38 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 1073741824 Sep 28 12:13:38 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:38 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.731s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 8 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:13:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:13:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:39 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 1073741824" returned: 0 in 0.842s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:39 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 Sep 28 12:13:39 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:39 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329" returned: 0 in 0.396s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d439407-903c-41fb-ae57-ef43deac6d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadcf986-55cb-470d-9383-39a0ec2b7075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Creating offline snapshot 76bbe538-bef4-4d26-b048-40e5df0c487e of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:13:40 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Volume volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 (9828fb73-4b19-45ba-bcc7-1b2d071a0329): created successfully Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fadcf986-55cb-470d-9383-39a0ec2b7075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Flow 'volume_create_manager' (aa13e4bc-6588-46de-97d3-8e27e683869d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb676d5-9b4f-44e3-978d-8973fae11bab]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:40 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8e2357a6-7700-414e-b6dd-81abf1c9cae7 tempest-DeleteServersTestJSON-1617346340 None] Created volume successfully. Sep 28 12:13:40 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:40 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:41 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 1.095s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:41 devstack sudo[90386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e 1G Sep 28 12:13:41 devstack sudo[90386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:42 devstack sudo[90386]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e 1G" returned: 0 in 1.136s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:42 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e Sep 28 12:13:42 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-519731aa-6fbc-457a-9acc-91b1769ee434 req-292c72d7-9e47-4ab4-a2b9-dd5bfdd459d0 tempest-DeleteServersTestJSON-1617346340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:43 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e" returned: 0 in 0.736s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:43 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e is being set with open permissions: ugo+rw Sep 28 12:13:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:43 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e Sep 28 12:13:43 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:43 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e" returned: 0 in 0.331s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.634s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-519731aa-6fbc-457a-9acc-91b1769ee434 req-292c72d7-9e47-4ab4-a2b9-dd5bfdd459d0 tempest-DeleteServersTestJSON-1617346340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.402s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-519731aa-6fbc-457a-9acc-91b1769ee434 req-292c72d7-9e47-4ab4-a2b9-dd5bfdd459d0 tempest-DeleteServersTestJSON-1617346340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.053s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6656bdab-c692-431b-804c-5de7d483b606 tempest-SnapshotsActionsTest-1673486302 None] Create snapshot completed successfully Sep 28 12:13:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-519731aa-6fbc-457a-9acc-91b1769ee434 req-292c72d7-9e47-4ab4-a2b9-dd5bfdd459d0 tempest-DeleteServersTestJSON-1617346340 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fd90c730-dd29-406f-ab49-2bf55ac73104', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:13:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-519731aa-6fbc-457a-9acc-91b1769ee434 req-292c72d7-9e47-4ab4-a2b9-dd5bfdd459d0 tempest-DeleteServersTestJSON-1617346340 None] attachment_update completed successfully. Sep 28 12:13:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-76bbe538-bef4-4d26-b048-40e5df0c487e-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-76bbe538-bef4-4d26-b048-40e5df0c487e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.087s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" acquired by "delete_snapshot" :: waited 0.074s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-quobyte-76bbe538-bef4-4d26-b048-40e5df0c487e" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-76bbe538-bef4-4d26-b048-40e5df0c487e" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Deleting offline snapshot 76bbe538-bef4-4d26-b048-40e5df0c487e of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:13:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] snapshot_file for this snap is: volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:13:45 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3684a3d-b95a-4f8b-9a25-f45d7644b160]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:45 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e Sep 28 12:13:45 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:46 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e" returned: 0 in 0.946s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:46 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f043cd1-a805-4975-8596-4b6e8b355ee4]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:46 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:46 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:47 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.977s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:47 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e Sep 28 12:13:47 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:48 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e" returned: 0 in 0.792s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:48 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e Sep 28 12:13:48 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:48 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.76bbe538-bef4-4d26-b048-40e5df0c487e" returned: 0 in 0.545s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-76bbe538-bef4-4d26-b048-40e5df0c487e" released by "_delete_snapshot" :: held 3.563s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" released by "delete_snapshot" :: held 3.638s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:48 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Created reservations ['c7f1d957-f976-489a-bd77-e683eb651f85', 'ea3a2bcc-9024-471e-b1c6-1308a7431532', '1b0a3007-cdf9-469d-aa93-7b86f9d38cae', 'c328ee7d-7725-4003-96ff-5d30363d4c3a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Delete snapshot completed successfully. Sep 28 12:13:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-265eb5f1-2d65-431e-b498-74fc36f07d32 tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-76bbe538-bef4-4d26-b048-40e5df0c487e-delete_snapshot" released by "delete_snapshot" :: held 4.106s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-00de0aa9-82ba-4db0-ac68-e2c163469c51 req-7cd46929-fa37-4fe8-b2d8-65b4c5d8d774 tempest-DeleteServersTestJSON-1617346340 None] Terminate volume connection completed successfully. Sep 28 12:13:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-00de0aa9-82ba-4db0-ac68-e2c163469c51 req-7cd46929-fa37-4fe8-b2d8-65b4c5d8d774 tempest-DeleteServersTestJSON-1617346340 None] Deleting attachment fd90c730-dd29-406f-ab49-2bf55ac73104. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:13:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Creating offline snapshot c4660baa-bd11-4124-8b8c-55781e4fbcb6 of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:13:50 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c6b7118-d23c-459d-b549-e14386ff39ae]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:50 devstack sudo[90539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:50 devstack sudo[90539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:50 devstack sudo[90539]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.559s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:50 devstack sudo[90545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 1G Sep 28 12:13:50 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Acquiring lock "cinder-9828fb73-4b19-45ba-bcc7-1b2d071a0329-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Lock "cinder-9828fb73-4b19-45ba-bcc7-1b2d071a0329-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Acquiring lock "cinder-quobyte-9828fb73-4b19-45ba-bcc7-1b2d071a0329" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Lock "cinder-quobyte-9828fb73-4b19-45ba-bcc7-1b2d071a0329" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef25a23-d868-4479-9814-185472df8d66]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:51 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 1G" returned: 0 in 0.550s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:51 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 Sep 28 12:13:51 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:51 devstack sudo[90551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 Sep 28 12:13:51 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:51 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329" returned: 0 in 0.386s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:51 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329 Sep 28 12:13:51 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:51 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6" returned: 0 in 0.371s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:51 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 is being set with open permissions: ugo+rw Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:51 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 Sep 28 12:13:51 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:51 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9828fb73-4b19-45ba-bcc7-1b2d071a0329" returned: 0 in 0.440s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Lock "cinder-quobyte-9828fb73-4b19-45ba-bcc7-1b2d071a0329" released by "delete_volume" :: held 0.878s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:51 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6" returned: 0 in 0.428s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7d2f43c2-dce4-4bb4-97be-72ffca2dc598 tempest-SnapshotsActionsTest-1673486302 None] Create snapshot completed successfully Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Created reservations ['a1f8de10-90ac-4674-9e6f-d53536b22f89', 'f8af4663-5f44-4797-8c54-68054cdd75f8', '10c7f108-4dc5-454a-b10c-316ec4e4261a', '5b3aa1bc-9b86-42bf-83c9-d8a546ec5405'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:52 devstack sudo[90568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:13:52 devstack sudo[90568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:52 devstack sudo[90568]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.245s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:13:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Deleted volume successfully. Sep 28 12:13:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfb0c17c-ec6c-4e64-9a31-50120f06ce77 tempest-DeleteServersTestJSON-1617346340 None] Lock "cinder-9828fb73-4b19-45ba-bcc7-1b2d071a0329-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-c4660baa-bd11-4124-8b8c-55781e4fbcb6-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-c4660baa-bd11-4124-8b8c-55781e4fbcb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Acquiring lock "cinder-quobyte-c4660baa-bd11-4124-8b8c-55781e4fbcb6" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-c4660baa-bd11-4124-8b8c-55781e4fbcb6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Deleting offline snapshot c4660baa-bd11-4124-8b8c-55781e4fbcb6 of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] snapshot_file for this snap is: volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f681c989-99c6-41d2-9027-a3d6e80391d1]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:53 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 Sep 28 12:13:53 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:53 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6" returned: 0 in 0.482s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2b7a98-da4b-498d-9990-193939ac3f88]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:54 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:54 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:54 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.435s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:54 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 Sep 28 12:13:54 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:55 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6" returned: 0 in 0.597s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:55 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6 Sep 28 12:13:55 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:55 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.c4660baa-bd11-4124-8b8c-55781e4fbcb6" returned: 0 in 0.349s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-c4660baa-bd11-4124-8b8c-55781e4fbcb6" released by "_delete_snapshot" :: held 2.019s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" released by "delete_snapshot" :: held 2.064s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:55 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Created reservations ['20460ea1-f665-46d3-bf00-fee9acf70aee', '3b2a1f8c-ab84-4658-a399-a72de7ba5366', '59a4206d-8dfe-4071-ad3d-7ee22b8fb95b', '0c4113ab-1610-4bde-b96d-c9b3b198e584'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:55 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Delete snapshot completed successfully. Sep 28 12:13:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4d9a8a94-3f34-44f4-965a-260e25a4976a tempest-SnapshotsActionsTest-303703303 None] Lock "cinder-c4660baa-bd11-4124-8b8c-55781e4fbcb6-delete_snapshot" released by "delete_snapshot" :: held 2.352s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "cinder-53ba5d27-e357-4289-952a-241e0f4bc1b7-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-53ba5d27-e357-4289-952a-241e0f4bc1b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "cinder-quobyte-53ba5d27-e357-4289-952a-241e0f4bc1b7" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-quobyte-53ba5d27-e357-4289-952a-241e0f4bc1b7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Deleting offline snapshot 53ba5d27-e357-4289-952a-241e0f4bc1b7 of volume 99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] snapshot_file for this snap is: volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca7e944-4ce2-480f-9bec-7da0579be9ec]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:57 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:57 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:57 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.555s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[790cab9c-6577-4ec4-ae11-557e00a3501f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:13:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:57 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 Sep 28 12:13:57 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:58 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3" returned: 0 in 0.568s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:58 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:58 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Flow 'volume_create_manager' (670f6848-1363-490e-8e62-185c749eb229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7294b345-8607-47aa-9ba2-c810c96ea732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7294b345-8607-47aa-9ba2-c810c96ea732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1399415264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc92bb6-7610-4997-8a5a-f74e3964153d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfe7c57e1b34df3b27770f5e6bfb595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:59Z,use_quota=True,user_id='489dba938ba544d39c4e7808e95a43ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be998990-cdec-40dc-b6d7-f5db3ae65d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be998990-cdec-40dc-b6d7-f5db3ae65d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bdaab0-8bde-439d-9bba-f4ada3c222ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bdaab0-8bde-439d-9bba-f4ada3c222ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc92bb6-7610-4997-8a5a-f74e3964153d', 'volume_name': 'volume-4bc92bb6-7610-4997-8a5a-f74e3964153d', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e3dda3-ae22-48d6-b72d-d52a01784717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e3dda3-ae22-48d6-b72d-d52a01784717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75a9d85-686c-4db9-baf7-3372fcf9558d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:13:58 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Volume 4bc92bb6-7610-4997-8a5a-f74e3964153d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc92bb6-7610-4997-8a5a-f74e3964153d', 'volume_size': 1} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1399415264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc92bb6-7610-4997-8a5a-f74e3964153d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfe7c57e1b34df3b27770f5e6bfb595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:13:59Z,use_quota=True,user_id='489dba938ba544d39c4e7808e95a43ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Creating volume 4bc92bb6-7610-4997-8a5a-f74e3964153d {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:13:58 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:13:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:58 devstack sudo[90651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d 1073741824 Sep 28 12:13:58 devstack sudo[90651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:59 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.727s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:59 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7 Sep 28 12:13:59 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:59 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3.53ba5d27-e357-4289-952a-241e0f4bc1b7" returned: 0 in 0.341s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-quobyte-53ba5d27-e357-4289-952a-241e0f4bc1b7" released by "_delete_snapshot" :: held 2.398s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" released by "delete_snapshot" :: held 2.443s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:59 devstack sudo[90651]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Created reservations ['f08bcad8-9f61-4be1-9932-29c45527441c', 'deff7cd8-3f52-45cc-be78-f1be95741071', '3ad18837-de82-4163-bb54-408dcc339edb', '7d236eb4-87b8-47d4-8d77-33f2363f885e'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d 1073741824" returned: 0 in 0.696s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:13:59 devstack sudo[90660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d Sep 28 12:13:59 devstack sudo[90660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:13:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Delete snapshot completed successfully. Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a829ea0b-46fb-4a2e-9ea3-d10cd5121d8f tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-53ba5d27-e357-4289-952a-241e0f4bc1b7-delete_snapshot" released by "delete_snapshot" :: held 2.661s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:13:59 devstack sudo[90660]: pam_unix(sudo:session): session closed for user root Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d" returned: 0 in 0.280s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75a9d85-686c-4db9-baf7-3372fcf9558d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc92bb6-7610-4997-8a5a-f74e3964153d', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:13:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b982f127-d6df-4999-8a83-89ed8de3210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:00 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Volume volume-4bc92bb6-7610-4997-8a5a-f74e3964153d (4bc92bb6-7610-4997-8a5a-f74e3964153d): created successfully Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b982f127-d6df-4999-8a83-89ed8de3210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Flow 'volume_create_manager' (670f6848-1363-490e-8e62-185c749eb229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:00 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-95fa7cc8-cbd4-41e9-884c-7f07c332c2d1 req-58b94937-fa8e-469a-9a46-372392dcec36 tempest-VolumesSnapshotsTestJSON-417841205 None] Created volume successfully. Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "cinder-99a5d268-fc6b-431b-8f51-f7ad03501eb3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-99a5d268-fc6b-431b-8f51-f7ad03501eb3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b89fdf3-fde3-40ee-9b09-4e45fe9978bc]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:00 devstack sudo[90688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 Sep 28 12:14:00 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:00 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3" returned: 0 in 0.445s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:00 devstack sudo[90700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3 Sep 28 12:14:00 devstack sudo[90700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Creating offline snapshot a4b2073e-70df-4dea-89dc-9de97a45e3a4 of volume 4bc92bb6-7610-4997-8a5a-f74e3964153d {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e99a22-63a5-4b8a-b2cb-41940f06074a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:01 devstack sudo[90700]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-99a5d268-fc6b-431b-8f51-f7ad03501eb3" returned: 0 in 0.326s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:01 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d Sep 28 12:14:01 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-quobyte-99a5d268-fc6b-431b-8f51-f7ad03501eb3" released by "delete_volume" :: held 0.840s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Created reservations ['45260659-08d9-4a66-af5e-9f3e7aca0e29', 'c80adea0-07fd-4e0d-888d-fd1d7915c49c', 'e4470bbf-af6c-4263-8c47-f2051967b87a', 'fe35644e-709a-44bc-a1cd-8dcd700a1034'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:01 devstack sudo[90705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:14:01 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:01 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d" returned: 0 in 0.563s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:01 devstack sudo[90711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 1G Sep 28 12:14:01 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:01 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.335s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:14:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Deleted volume successfully. Sep 28 12:14:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1deb729c-52f5-43af-bfaa-03b009fc6f70 tempest-SnapshotsActionsTest-1673486302 None] Lock "cinder-99a5d268-fc6b-431b-8f51-f7ad03501eb3-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:02 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 1G" returned: 0 in 0.525s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bc92bb6-7610-4997-8a5a-f74e3964153d -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:02 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bc92bb6-7610-4997-8a5a-f74e3964153d -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 Sep 28 12:14:02 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:02 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4bc92bb6-7610-4997-8a5a-f74e3964153d -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4" returned: 0 in 0.344s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:02 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 is being set with open permissions: ugo+rw Sep 28 12:14:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:02 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 Sep 28 12:14:02 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:02 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4" returned: 0 in 0.309s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:02 devstack sudo[90727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.info Sep 28 12:14:02 devstack sudo[90727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:03 devstack sudo[90727]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.info" returned: 0 in 0.313s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:03 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.info is being set with open permissions: ugo+rw Sep 28 12:14:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:03 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.info Sep 28 12:14:03 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:03 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.info" returned: 0 in 0.280s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:03 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-9f01ae99-3516-4e11-b688-24e50144b182 req-e54b6249-e7c0-4ca6-aa79-48a1fd7a2daf tempest-VolumesSnapshotsTestJSON-417841205 None] Create snapshot completed successfully Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Acquiring lock "cinder-a4b2073e-70df-4dea-89dc-9de97a45e3a4-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-a4b2073e-70df-4dea-89dc-9de97a45e3a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Acquiring lock "cinder-quobyte-4bc92bb6-7610-4997-8a5a-f74e3964153d" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-quobyte-4bc92bb6-7610-4997-8a5a-f74e3964153d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Acquiring lock "cinder-quobyte-a4b2073e-70df-4dea-89dc-9de97a45e3a4" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-quobyte-a4b2073e-70df-4dea-89dc-9de97a45e3a4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Deleting offline snapshot a4b2073e-70df-4dea-89dc-9de97a45e3a4 of volume 4bc92bb6-7610-4997-8a5a-f74e3964153d {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] snapshot_file for this snap is: volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2e52e1-09b5-4c34-b51c-9d4099c8229a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:04 devstack sudo[90733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 Sep 28 12:14:04 devstack sudo[90733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:04 devstack sudo[90733]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4" returned: 0 in 0.462s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4bc92bb6-7610-4997-8a5a-f74e3964153d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92dfcf3-f864-4836-9fdf-7c9f2d9d19db]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:04 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d Sep 28 12:14:04 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:05 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d" returned: 0 in 0.488s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:05 devstack sudo[90743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 Sep 28 12:14:05 devstack sudo[90743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:05 devstack sudo[90743]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4" returned: 0 in 0.414s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:05 devstack sudo[90748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4 Sep 28 12:14:05 devstack sudo[90748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:05 devstack sudo[90748]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d.a4b2073e-70df-4dea-89dc-9de97a45e3a4" returned: 0 in 0.306s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-quobyte-a4b2073e-70df-4dea-89dc-9de97a45e3a4" released by "_delete_snapshot" :: held 1.918s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-quobyte-4bc92bb6-7610-4997-8a5a-f74e3964153d" released by "delete_snapshot" :: held 1.955s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG cinder.quota [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Created reservations ['6df6366f-809a-4b2e-bcde-9bcdf7452d1e', '0b19524c-9ea4-4b27-8128-eac67a6032e3', '69062ef8-7af9-47f2-9b16-75f92a935c64', '133fb13c-24dd-4429-b8b9-9a61600338ca'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Delete snapshot completed successfully. Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-a85fd3f4-c537-4511-99a6-e9e04b07a5a8 req-89066394-29ad-4f4c-9d7b-8cf5fddc76bb tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-a4b2073e-70df-4dea-89dc-9de97a45e3a4-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Acquiring lock "cinder-4bc92bb6-7610-4997-8a5a-f74e3964153d-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-4bc92bb6-7610-4997-8a5a-f74e3964153d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Acquiring lock "cinder-quobyte-4bc92bb6-7610-4997-8a5a-f74e3964153d" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-quobyte-4bc92bb6-7610-4997-8a5a-f74e3964153d" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a7a57f-f31c-4d62-a827-2ab8b92c069e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:06 devstack sudo[90751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d Sep 28 12:14:06 devstack sudo[90751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:07 devstack sudo[90751]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d" returned: 0 in 0.496s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:07 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d Sep 28 12:14:07 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:07 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4bc92bb6-7610-4997-8a5a-f74e3964153d" returned: 0 in 0.326s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-quobyte-4bc92bb6-7610-4997-8a5a-f74e3964153d" released by "delete_volume" :: held 0.939s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG cinder.quota [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Created reservations ['cfddb6ed-7ad2-464a-b0bd-628312900d76', '5aa90844-9c76-471a-9782-659de9c4e2f2', 'a4e8e132-315c-4901-b4bb-d6b2cdd489f0', '1ed9e830-4249-4fc3-a00d-88beec4fb05d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:07 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:14:07 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:08 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.355s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:08 devstack cinder-volume[87048]: DEBUG cinder.manager [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:14:08 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Deleted volume successfully. Sep 28 12:14:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-45bf1dbf-60ef-4b23-8cb0-226ecb78d861 req-6e0df5d7-329c-4930-b958-c84eb8d644b1 tempest-VolumesSnapshotsTestJSON-417841205 None] Lock "cinder-4bc92bb6-7610-4997-8a5a-f74e3964153d-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:11 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=98,cinder:UPDATE=86,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:14:11 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-11b90e72-78c9-4fff-98b5-71ac38d4a700 req-b09d200d-7437-4fe3-bd0f-69a12d709f94 tempest-ServerActionsTestOtherA-484120818 None] Terminate volume connection completed successfully. Sep 28 12:14:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-11b90e72-78c9-4fff-98b5-71ac38d4a700 req-b09d200d-7437-4fe3-bd0f-69a12d709f94 tempest-ServerActionsTestOtherA-484120818 None] Deleting attachment dc61e41e-ca4b-428d-acdb-6cc40e9cb838. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:14:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-72fe62ec-7092-412b-8c37-e742d7d8e8c9 tempest-BackendsCapabilitiesAdminTestsJSON-111791172 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2088623046875, 'free_capacity_gb': 1775.2088623046875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87048) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 12:14:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2ebae5fd-49f2-431d-8afa-6c33171d945b tempest-BackendsCapabilitiesAdminTestsJSON-111791172 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2088623046875, 'free_capacity_gb': 1775.2088623046875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87048) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 12:14:21 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=106,cinder:UPDATE=88,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:14:21 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:14:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Flow 'volume_create_manager' (33dcf73e-2ba2-451c-ab1a-f4a5771122c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb0b02a-ba64-488a-b206-469b76b1ce17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb0b02a-ba64-488a-b206-469b76b1ce17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1889704787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40836eaa-154b-483d-8c4c-2d638f7fb54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d76f4883b504584b4f375d9f27d732b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:21Z,use_quota=True,user_id='09ea06dcda7d486abb4601b9b1133ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7344c842-a14c-4374-9fb5-6a48d4bf8a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7344c842-a14c-4374-9fb5-6a48d4bf8a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c6928e-32d3-4224-82a8-db8c31f50275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:21 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:14:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c6928e-32d3-4224-82a8-db8c31f50275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '40836eaa-154b-483d-8c4c-2d638f7fb54b', 'volume_name': 'volume-40836eaa-154b-483d-8c4c-2d638f7fb54b', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae9af8d-6835-4acf-a9d6-209bdbcac810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ae9af8d-6835-4acf-a9d6-209bdbcac810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292cb91d-3246-4870-9cdc-a4647b800827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:22 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Volume 40836eaa-154b-483d-8c4c-2d638f7fb54b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-40836eaa-154b-483d-8c4c-2d638f7fb54b', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:14:22 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Trying to clone 40836eaa-154b-483d-8c4c-2d638f7fb54b from image d446342e-1c65-4f57-97fb-ae62bc9167ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:14:23 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c86928-36df-41f8-943f-8b6b092a11b5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:14:23 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD Sep 28 12:14:23 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Flow 'volume_create_manager' (39049955-ba54-49d8-96bb-61fb1a6d640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61c2576-378c-4f68-a18d-d0162cd0123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61c2576-378c-4f68-a18d-d0162cd0123e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1744763117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c02c0b-5167-41b5-a7ac-a0e8d00146cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58fbfbd624746a2a82f9f290e01f214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:23Z,use_quota=True,user_id='06c24ed292b8406199c13c362df61302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99123c16-e57e-44da-abfb-ce32cf29482b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99123c16-e57e-44da-abfb-ce32cf29482b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a5c07b-28dc-46d3-b114-0542bcb399a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a5c07b-28dc-46d3-b114-0542bcb399a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8c02c0b-5167-41b5-a7ac-a0e8d00146cb', 'volume_name': 'volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003146a8-198d-439b-a01f-acc3b55ec4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (003146a8-198d-439b-a01f-acc3b55ec4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803dd58c-0c8f-4eae-be03-c90b63645f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:23 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Volume b8c02c0b-5167-41b5-a7ac-a0e8d00146cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb', 'volume_size': 1} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1744763117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8c02c0b-5167-41b5-a7ac-a0e8d00146cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58fbfbd624746a2a82f9f290e01f214',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:23Z,use_quota=True,user_id='06c24ed292b8406199c13c362df61302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Creating volume b8c02c0b-5167-41b5-a7ac-a0e8d00146cb {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:23 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:23 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb 1073741824 Sep 28 12:14:23 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:23 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef is fetched for user 09ea06dcda7d486abb4601b9b1133ded. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[71793e46-d6e2-450c-a3b0-d39a008beb7a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:23 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD Sep 28 12:14:23 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:24 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb 1073741824" returned: 0 in 0.760s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:24 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD" returned: 0 in 0.485s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:24 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb Sep 28 12:14:24 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:24 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb" returned: 0 in 0.363s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] <== create_volume: return (1232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.415s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1889704787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40836eaa-154b-483d-8c4c-2d638f7fb54b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d76f4883b504584b4f375d9f27d732b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:21Z,use_quota=True,user_id='09ea06dcda7d486abb4601b9b1133ded',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Creating volume 40836eaa-154b-483d-8c4c-2d638f7fb54b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:24 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:24 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b 1073741824 Sep 28 12:14:24 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (803dd58c-0c8f-4eae-be03-c90b63645f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb042f6-7d5d-4791-bf4f-eb06a0dfed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:24 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Volume volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb (b8c02c0b-5167-41b5-a7ac-a0e8d00146cb): created successfully Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb042f6-7d5d-4791-bf4f-eb06a0dfed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Flow 'volume_create_manager' (39049955-ba54-49d8-96bb-61fb1a6d640e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:24 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ce0f11cd-b49e-4853-8fc1-7a0bdd630ca7 tempest-VolumesServicesTestJSON-1523317832 None] Created volume successfully. Sep 28 12:14:25 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e78e5708-d260-49c9-bfdb-3dc4f6ae6d8d tempest-GroupSnapshotsTest-1237001898 None] Group tempest-GroupSnapshotsTest-Group-1234015249: creating Sep 28 12:14:25 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e78e5708-d260-49c9-bfdb-3dc4f6ae6d8d tempest-GroupSnapshotsTest-1237001898 None] Group tempest-GroupSnapshotsTest-Group-1234015249: created successfully Sep 28 12:14:25 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e78e5708-d260-49c9-bfdb-3dc4f6ae6d8d tempest-GroupSnapshotsTest-1237001898 None] Create group completed successfully. Sep 28 12:14:25 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b 1073741824" returned: 0 in 0.739s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:25 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b Sep 28 12:14:25 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Acquiring lock "cinder-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Lock "cinder-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Acquiring lock "cinder-quobyte-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Lock "cinder-quobyte-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb" acquired by "delete_volume" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2775ab-4363-448b-88b0-b906df215120]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:25 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b" returned: 0 in 0.425s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:25 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:14:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.234s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:25 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Attempting download of d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume 40836eaa-154b-483d-8c4c-2d638f7fb54b. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2c031b-ec89-4830-9a37-249429abd625]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef__2biitpj {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:26 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef__2biitpj Sep 28 12:14:26 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:26 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb" returned: 0 in 0.492s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:26 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb Sep 28 12:14:26 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:26 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef__2biitpj" returned: 0 in 0.401s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef__2biitpj {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:26 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef__2biitpj Sep 28 12:14:26 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:26 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb" returned: 0 in 0.329s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Lock "cinder-quobyte-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb" released by "delete_volume" :: held 0.892s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Created reservations ['75665bdf-5d5a-4916-8032-6b5f21be7f6c', '4dd8e649-ac85-4323-aba3-9821fcf6fb1b', '7f85fc53-5467-4dee-845b-dd4a48e62518', '7aa0732c-8552-4a4a-8b68-9344635782c6'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:26 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef__2biitpj" returned: 1 in 0.399s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef__2biitpj' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2662d3ce-d374-4d38-a0e7-0e060f39b0d8]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:27 devstack sudo[90897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:14:27 devstack sudo[90897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:27 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD Sep 28 12:14:27 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Flow 'volume_create_manager' (05bb454a-37f4-49d5-acb2-934ec9d26151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736d646d-2950-4243-859e-751d57e70e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736d646d-2950-4243-859e-751d57e70e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-996620152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=977b5fa0-b0ce-44b2-b21a-ddb49750be1c,host='devstack@QuobyteHD#QuobyteHD',id=fe9c31d4-2d2f-435d-8d5e-d03c0f884faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b3cc2d68be4fe4995239aae5d21263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:27Z,use_quota=True,user_id='a2d69a30d49147818d30e9ad08be33e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e97a28c-81bb-4256-8875-4678a39f44cb),volume_type_id=7e97a28c-81bb-4256-8875-4678a39f44cb)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57772a1-4f68-486a-8081-740c0b1b05a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57772a1-4f68-486a-8081-740c0b1b05a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85abc110-ee8b-4cb0-bafa-a3b714870530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85abc110-ee8b-4cb0-bafa-a3b714870530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe9c31d4-2d2f-435d-8d5e-d03c0f884faa', 'volume_name': 'volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6add6ad-6f89-4b11-b48e-c9cd16f85dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6add6ad-6f89-4b11-b48e-c9cd16f85dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:27 devstack sudo[90897]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23236c22-b890-4932-989f-a1694d4d5345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:27 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Volume fe9c31d4-2d2f-435d-8d5e-d03c0f884faa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa', 'volume_size': 1} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=977b5fa0-b0ce-44b2-b21a-ddb49750be1c,created_at=2026-09-28T10:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-996620152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=977b5fa0-b0ce-44b2-b21a-ddb49750be1c,host='devstack@QuobyteHD#QuobyteHD',id=fe9c31d4-2d2f-435d-8d5e-d03c0f884faa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b3cc2d68be4fe4995239aae5d21263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:27Z,use_quota=True,user_id='a2d69a30d49147818d30e9ad08be33e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e97a28c-81bb-4256-8875-4678a39f44cb),volume_type_id=7e97a28c-81bb-4256-8875-4678a39f44cb)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Creating volume fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:27 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:27 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.400s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD" returned: 0 in 0.534s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] d446342e-1c65-4f57-97fb-ae62bc9167ef was qcow2, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:27 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa 1073741824 Sep 28 12:14:27 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Deleted volume successfully. Sep 28 12:14:27 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b Sep 28 12:14:27 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8ab774a0-5c3e-4aa9-b782-c9c5cad5c279 tempest-VolumesServicesTestJSON-1523317832 None] Lock "cinder-b8c02c0b-5167-41b5-a7ac-a0e8d00146cb-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:28 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa 1073741824" returned: 0 in 0.603s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:28 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa Sep 28 12:14:28 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:28 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" returned: 0 in 0.483s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:14:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23236c22-b890-4932-989f-a1694d4d5345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf433c58-8b28-418e-bc28-45802a4005c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:28 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Volume volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa (fe9c31d4-2d2f-435d-8d5e-d03c0f884faa): created successfully Sep 28 12:14:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf433c58-8b28-418e-bc28-45802a4005c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Flow 'volume_create_manager' (05bb454a-37f4-49d5-acb2-934ec9d26151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-76ed2f12-4dbb-498f-9faa-e23bf1e837b7 tempest-GroupSnapshotsTest-1237001898 None] Created volume successfully. Sep 28 12:14:30 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] GroupSnapshot 0a180b69-e371-4ab3-a9be-0f816541bacd: creating. Sep 28 12:14:30 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Group snapshot 0a180b69-e371-4ab3-a9be-0f816541bacd: creating. {{(pid=87048) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 12:14:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Creating offline snapshot 7b8ddfa4-98bd-4f51-9035-d4cce39ac875 of volume fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:14:30 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f4b4a7-a186-4cb0-9a95-d3e7e8dd0396]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:30 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa Sep 28 12:14:30 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:30 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b" returned: 0 in 3.514s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:30 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_7xpjwyi6devstack@QuobyteHD, size 112.00 MB, duration 3.52 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:14:30 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Converted 112.00 MB image at 31.84 MB/s Sep 28 12:14:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:31 devstack sudo[91010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b 1G Sep 28 12:14:31 devstack sudo[91010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:31 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" returned: 0 in 0.933s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:31 devstack sudo[91010]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b 1G" returned: 0 in 0.660s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:31 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Downloaded image d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume 40836eaa-154b-483d-8c4c-2d638f7fb54b successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:14:31 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef for user 09ea06dcda7d486abb4601b9b1133ded is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:14:31 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Marking volume 40836eaa-154b-483d-8c4c-2d638f7fb54b as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:14:31 devstack sudo[91019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 1G Sep 28 12:14:31 devstack sudo[91019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:31 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Copying metadata from image d446342e-1c65-4f57-97fb-ae62bc9167ef to 40836eaa-154b-483d-8c4c-2d638f7fb54b. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:14:31 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Creating volume glance metadata for volume 40836eaa-154b-483d-8c4c-2d638f7fb54b backed by image d446342e-1c65-4f57-97fb-ae62bc9167ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:14:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292cb91d-3246-4870-9cdc-a4647b800827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40836eaa-154b-483d-8c4c-2d638f7fb54b', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaf1576-7ef3-4791-aaf7-b72f719db6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:32 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Volume volume-40836eaa-154b-483d-8c4c-2d638f7fb54b (40836eaa-154b-483d-8c4c-2d638f7fb54b): created successfully Sep 28 12:14:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeaf1576-7ef3-4791-aaf7-b72f719db6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Flow 'volume_create_manager' (33dcf73e-2ba2-451c-ab1a-f4a5771122c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:32 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-782b069f-b04c-408f-93f3-b61a12634bb3 tempest-ServerActionsTestOtherA-484120818 None] Created volume successfully. Sep 28 12:14:32 devstack sudo[91019]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 1G" returned: 0 in 1.070s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:32 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 Sep 28 12:14:32 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:33 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875" returned: 0 in 0.586s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:33 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:14:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:33 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 Sep 28 12:14:33 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:33 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875" returned: 0 in 0.505s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:33 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.info Sep 28 12:14:33 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:34 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.info" returned: 0 in 0.404s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:34 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:14:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:34 devstack sudo[91039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.info Sep 28 12:14:34 devstack sudo[91039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:34 devstack sudo[91039]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.info" returned: 0 in 0.606s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.306s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-19b490dd-d926-4b57-8ac5-d24fa146dea6 tempest-GroupSnapshotsTest-1237001898 None] group_snapshot 0a180b69-e371-4ab3-a9be-0f816541bacd: created successfully Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-7b8ddfa4-98bd-4f51-9035-d4cce39ac875-fb8ab834-e454-45d7-960d-6c19a4de6e5c" by "_create_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-7b8ddfa4-98bd-4f51-9035-d4cce39ac875-fb8ab834-e454-45d7-960d-6c19a4de6e5c" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Creating volume fb8ab834-e454-45d7-960d-6c19a4de6e5c from snapshot 7b8ddfa4-98bd-4f51-9035-d4cce39ac875 {{(pid=87048) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-fb8ab834-e454-45d7-960d-6c19a4de6e5c" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-fb8ab834-e454-45d7-960d-6c19a4de6e5c" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] snapshot: 7b8ddfa4-98bd-4f51-9035-d4cce39ac875, volume: fb8ab834-e454-45d7-960d-6c19a4de6e5c, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bf0e3a-f282-4850-a182-38e8e2449a49]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:37 devstack sudo[91050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 Sep 28 12:14:37 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:38 devstack sudo[91060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:14:38 devstack sudo[91060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-a7c07447-66e1-44cd-8273-84998755fcbe req-ad33f45b-dbd1-4c53-91a5-39d65d46c6e7 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:38 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875" returned: 0 in 0.853s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2489513-9a05-4e69-bf67-bb25ddf8e148]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:38 devstack sudo[91060]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.548s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:14:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:14:38 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa Sep 28 12:14:38 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:39 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" returned: 0 in 0.554s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:14:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:14:39 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:14:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:39 devstack sudo[91072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c Sep 28 12:14:39 devstack sudo[91072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Flow 'volume_create_manager' (ddad3317-fe42-4202-8649-59bf368e37be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43438cc-8551-4ea5-84ef-5fbb8f339365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c43438cc-8551-4ea5-84ef-5fbb8f339365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-70071097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2cd7f2-f6fb-48b1-9097-5dae99de9c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97419cd767cd406492ef3ef57d511cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:43Z,use_quota=True,user_id='80b3bf7789564041adeb88679df88b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9236ef5-c9f3-42aa-94c9-4c88c24d3329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9236ef5-c9f3-42aa-94c9-4c88c24d3329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e410da58-0cf5-44b4-8677-aef9f5e6a1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e410da58-0cf5-44b4-8677-aef9f5e6a1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c2cd7f2-f6fb-48b1-9097-5dae99de9c07', 'volume_name': 'volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9c9a20-fdb5-4e8a-9d72-3b08effb0929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9c9a20-fdb5-4e8a-9d72-3b08effb0929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7473dc08-dc0c-4cdb-938c-a7cdd9387465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:43 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Volume 6c2cd7f2-f6fb-48b1-9097-5dae99de9c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07', 'volume_size': 1} Sep 28 12:14:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:48 devstack sudo[91072]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c" returned: 0 in 9.263s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa, size 1024.00 MB, duration 9.26 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:14:48 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Converted 1024.00 MB image at 110.53 MB/s Sep 28 12:14:48 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:48 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c Sep 28 12:14:48 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:48 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c" returned: 0 in 0.267s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-fb8ab834-e454-45d7-960d-6c19a4de6e5c" released by "_copy_volume_from_snapshot" :: held 11.130s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-7b8ddfa4-98bd-4f51-9035-d4cce39ac875-fb8ab834-e454-45d7-960d-6c19a4de6e5c" released by "_create_volume_from_snapshot" :: held 11.243s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.286s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-a7c07447-66e1-44cd-8273-84998755fcbe req-ad33f45b-dbd1-4c53-91a5-39d65d46c6e7 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.247s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-a7c07447-66e1-44cd-8273-84998755fcbe req-ad33f45b-dbd1-4c53-91a5-39d65d46c6e7 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.140s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-70071097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c2cd7f2-f6fb-48b1-9097-5dae99de9c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97419cd767cd406492ef3ef57d511cf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:43Z,use_quota=True,user_id='80b3bf7789564041adeb88679df88b41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Creating volume 6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:48 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:48 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 1073741824 Sep 28 12:14:48 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-a7c07447-66e1-44cd-8273-84998755fcbe req-ad33f45b-dbd1-4c53-91a5-39d65d46c6e7 tempest-ServerActionsTestOtherA-484120818 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-40836eaa-154b-483d-8c4c-2d638f7fb54b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6477e7fc-03c6-4aed-a3dc-e1f10fb3aa56', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:14:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2b936c49-3313-44da-93d6-6a0b8e543fba tempest-GroupSnapshotsTest-1237001898 None] Create group from source-snapshot-0a180b69-e371-4ab3-a9be-0f816541bacd completed successfully. Sep 28 12:14:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-a7c07447-66e1-44cd-8273-84998755fcbe req-ad33f45b-dbd1-4c53-91a5-39d65d46c6e7 tempest-ServerActionsTestOtherA-484120818 None] attachment_update completed successfully. Sep 28 12:14:49 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 1073741824" returned: 0 in 0.495s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:49 devstack sudo[91127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 Sep 28 12:14:49 devstack sudo[91127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:49 devstack sudo[91127]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" returned: 0 in 0.392s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:14:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7473dc08-dc0c-4cdb-938c-a7cdd9387465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c0f97e-ecd5-4fa0-9b06-ef77795fa427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:49 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Volume volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 (6c2cd7f2-f6fb-48b1-9097-5dae99de9c07): created successfully Sep 28 12:14:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c0f97e-ecd5-4fa0-9b06-ef77795fa427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Flow 'volume_create_manager' (ddad3317-fe42-4202-8649-59bf368e37be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0cc51b39-ec98-4e91-953d-b8319f7def74 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Created volume successfully. Sep 28 12:14:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-fb8ab834-e454-45d7-960d-6c19a4de6e5c" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-fb8ab834-e454-45d7-960d-6c19a4de6e5c" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:50 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebbed00-ebb8-4553-bee2-9d2a510c826e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:50 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c Sep 28 12:14:50 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:50 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c" returned: 0 in 0.490s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:51 devstack sudo[91622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c Sep 28 12:14:51 devstack sudo[91622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Creating offline snapshot 3d3909d3-aead-4d75-999a-712c7c7251f0 of volume 6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e82a31b-7885-44e4-91c6-7163a73966bf]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:51 devstack sudo[91627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 Sep 28 12:14:51 devstack sudo[91627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:51 devstack sudo[91622]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fb8ab834-e454-45d7-960d-6c19a4de6e5c" returned: 0 in 0.304s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-fb8ab834-e454-45d7-960d-6c19a4de6e5c" released by "delete_volume" :: held 0.854s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['ea55c1ca-3d4b-4d3d-8e68-2a0c59eb5b0a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:51 devstack cinder-volume[87048]: WARNING cinder.quota [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1265696801 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1265696801, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:14:51 devstack cinder-volume[87048]: WARNING cinder.quota [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1265696801 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1265696801, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['1ee0145f-436f-423e-9bbe-507ca20d98ff', '4a5b20db-6ac1-46b3-bc6d-bce921034cc5', 'f94de7fc-98c5-4251-97a3-7873e5b8b7ec', '209d4a3b-90e6-4201-87ce-bdd607dea4a9'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:51 devstack sudo[91627]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" returned: 0 in 0.463s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:51 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 1G Sep 28 12:14:51 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:51 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:14:51 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:51 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.314s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:51 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:14:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2f52e2ab-ac26-4282-ac28-9c2fd08c7ae5 tempest-GroupSnapshotsTest-1237001898 None] Delete group completed successfully. Sep 28 12:14:52 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 1G" returned: 0 in 0.519s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:52 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 Sep 28 12:14:52 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:52 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0" returned: 0 in 0.444s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:52 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 is being set with open permissions: ugo+rw Sep 28 12:14:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:52 devstack sudo[91662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 Sep 28 12:14:52 devstack sudo[91662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] group_snapshot 0a180b69-e371-4ab3-a9be-0f816541bacd: deleting Sep 28 12:14:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] group_snapshot 0a180b69-e371-4ab3-a9be-0f816541bacd: deleting {{(pid=87048) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-7b8ddfa4-98bd-4f51-9035-d4cce39ac875" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:53 devstack sudo[91662]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0" returned: 0 in 0.497s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-7b8ddfa4-98bd-4f51-9035-d4cce39ac875" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Deleting offline snapshot 7b8ddfa4-98bd-4f51-9035-d4cce39ac875 of volume fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] snapshot_file for this snap is: volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b9ad48-a54f-4bf7-a59b-20c9a61839ce]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:53 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.info Sep 28 12:14:53 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:53 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 Sep 28 12:14:53 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:53 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.info" returned: 0 in 0.291s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:53 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.info is being set with open permissions: ugo+rw Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:53 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.info Sep 28 12:14:53 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:53 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875" returned: 0 in 0.520s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[531e1353-b3a8-4beb-85a8-83226dbe00cb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:53 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.info" returned: 0 in 0.298s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.734s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9dc37326-0a01-4bdd-83c2-75e89fc1407f tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Create snapshot completed successfully Sep 28 12:14:53 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa Sep 28 12:14:53 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:54 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" returned: 0 in 0.937s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:54 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 Sep 28 12:14:54 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Acquiring lock "cinder-3d3909d3-aead-4d75-999a-712c7c7251f0-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-3d3909d3-aead-4d75-999a-712c7c7251f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Acquiring lock "cinder-quobyte-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-quobyte-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Acquiring lock "cinder-quobyte-3d3909d3-aead-4d75-999a-712c7c7251f0" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-quobyte-3d3909d3-aead-4d75-999a-712c7c7251f0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Deleting offline snapshot 3d3909d3-aead-4d75-999a-712c7c7251f0 of volume 6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] snapshot_file for this snap is: volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b0147f-8905-4298-8a83-388a82be534b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:55 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875" returned: 0 in 0.675s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:55 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875 Sep 28 12:14:55 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:55 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 Sep 28 12:14:55 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:55 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa.7b8ddfa4-98bd-4f51-9035-d4cce39ac875" returned: 0 in 0.646s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-7b8ddfa4-98bd-4f51-9035-d4cce39ac875" released by "_delete_snapshot" :: held 2.961s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:56 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" released by "delete_snapshot" :: held 3.042s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0" returned: 0 in 0.863s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a639ae-cfe6-4073-b29a-4e733eade7a5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:56 devstack cinder-volume[87048]: WARNING cinder.quota [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1265696801 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1265696801, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['4e749c00-be39-4bf6-9dff-c802334110c4', 'df08367b-98bb-4e99-9bf7-75b2bfbe6f46', '87d055f9-f304-41ca-8f15-a8f5268ce05b', '709e16ec-9aae-4095-8d3e-2ed248647626'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Flow 'volume_create_manager' (2a8e7b66-b577-4cc3-8a23-e7537645e642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d9ae74-281b-44e8-86be-27593ba671d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:56 devstack sudo[91709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 Sep 28 12:14:56 devstack sudo[91709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11d9ae74-281b-44e8-86be-27593ba671d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-73594308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7e2c67-db08-454f-817e-e059c9836109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fce04b5e9d40f28187592a1f7f307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:56Z,use_quota=True,user_id='a4027e9c29ba4894888c11adc5f6f6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad345fd-ea36-40f6-a01f-cac90bc7d7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ad345fd-ea36-40f6-a01f-cac90bc7d7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b820e91-b932-4a85-8cf8-63ea53dfd90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b820e91-b932-4a85-8cf8-63ea53dfd90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7e2c67-db08-454f-817e-e059c9836109', 'volume_name': 'volume-6b7e2c67-db08-454f-817e-e059c9836109', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b244de-eff1-4355-a141-9393643ce3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b244de-eff1-4355-a141-9393643ce3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbcfa3d3-5a81-49fa-bb17-718a3670b276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:56 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Volume 6b7e2c67-db08-454f-817e-e059c9836109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7e2c67-db08-454f-817e-e059c9836109', 'volume_size': 1} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-73594308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7e2c67-db08-454f-817e-e059c9836109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fce04b5e9d40f28187592a1f7f307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:14:56Z,use_quota=True,user_id='a4027e9c29ba4894888c11adc5f6f6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Creating volume 6b7e2c67-db08-454f-817e-e059c9836109 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:14:56 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:56 devstack sudo[91711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109 1073741824 Sep 28 12:14:56 devstack sudo[91711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:56 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a7863803-46b4-480a-ad0f-7712be9c22ff tempest-GroupSnapshotsTest-1237001898 None] group_snapshot 0a180b69-e371-4ab3-a9be-0f816541bacd: deleted successfully Sep 28 12:14:56 devstack sudo[91709]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" returned: 0 in 0.615s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:56 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 Sep 28 12:14:56 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:57 devstack sudo[91711]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109 1073741824" returned: 0 in 0.847s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:57 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0" returned: 0 in 0.684s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:57 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109 Sep 28 12:14:57 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:57 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0 Sep 28 12:14:57 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:57 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109" returned: 0 in 0.459s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:14:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:14:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbcfa3d3-5a81-49fa-bb17-718a3670b276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7e2c67-db08-454f-817e-e059c9836109', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3a547d-ad09-4fb2-aeeb-1d1060c0c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:14:57 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Volume volume-6b7e2c67-db08-454f-817e-e059c9836109 (6b7e2c67-db08-454f-817e-e059c9836109): created successfully Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3a547d-ad09-4fb2-aeeb-1d1060c0c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:14:58 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Flow 'volume_create_manager' (2a8e7b66-b577-4cc3-8a23-e7537645e642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07.3d3909d3-aead-4d75-999a-712c7c7251f0" returned: 0 in 0.549s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:58 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-969357c3-4152-4428-8810-6622fcda0581 tempest-AttachVolumeTestJSON-1586863211 None] Created volume successfully. Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-quobyte-3d3909d3-aead-4d75-999a-712c7c7251f0" released by "_delete_snapshot" :: held 2.989s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-quobyte-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" released by "delete_snapshot" :: held 3.022s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" acquired by "delete_volume" :: waited 0.033s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[379da99c-91a0-488a-bc90-3710603676f0]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Created reservations ['31a6a8b4-737c-4f64-94bb-26351aeb11ac', '54dac6da-49eb-48dc-beb2-cbd1d9a946fe', '29d299c5-44ab-4944-a6b9-91c6a130b709', '126829fb-d747-49de-a80e-b5314206fa0a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:58 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Delete snapshot completed successfully. Sep 28 12:14:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d9d15214-a4c7-4cc2-9ef2-d4431083c7a4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-3d3909d3-aead-4d75-999a-712c7c7251f0-delete_snapshot" released by "delete_snapshot" :: held 3.438s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:58 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa Sep 28 12:14:58 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:59 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" returned: 0 in 0.779s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:14:59 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa Sep 28 12:14:59 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:14:59 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Sep 28 12:14:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" returned: 0 in 0.630s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:14:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-fe9c31d4-2d2f-435d-8d5e-d03c0f884faa" released by "delete_volume" :: held 1.548s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:14:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Acquiring lock "cinder-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:14:59 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['3d7fca8c-a7ae-423a-a5bd-d69f31c5adc1'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:14:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:00 devstack cinder-volume[87048]: WARNING cinder.db.api [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1265696801'] Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Acquiring lock "cinder-quobyte-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['c1393a47-60a9-49b0-b31a-7f9d2cd44a9a', 'd7c4e2a5-7998-4104-9897-da27722fd21e', '1e4efd27-661d-4615-a450-1d65ece37831', '4ddba501-10a0-4721-aa0a-53b92c4891b1'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-quobyte-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" acquired by "delete_volume" :: waited 0.065s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d11f41-eca8-48d9-804a-3bd85285213b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.085s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:00 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 Sep 28 12:15:00 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:00 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:15:00 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:01 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.560s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:01 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7266a8d2-75aa-4f76-b259-6023261faf5b tempest-GroupSnapshotsTest-1237001898 None] Delete group completed successfully. Sep 28 12:15:01 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" returned: 0 in 1.168s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-e46a5507-1c37-4468-9ca2-3a98513eec04 req-5924104a-a896-4de5-ac05-fff2a8ffa075 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-e46a5507-1c37-4468-9ca2-3a98513eec04 req-5924104a-a896-4de5-ac05-fff2a8ffa075 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-e46a5507-1c37-4468-9ca2-3a98513eec04 req-5924104a-a896-4de5-ac05-fff2a8ffa075 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:01 devstack sudo[91792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07 Sep 28 12:15:01 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-e46a5507-1c37-4468-9ca2-3a98513eec04 req-5924104a-a896-4de5-ac05-fff2a8ffa075 tempest-AttachVolumeTestJSON-1586863211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-6b7e2c67-db08-454f-817e-e059c9836109', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afdd7d72-479e-4ded-a579-97dcdd42fb7c', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:15:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-e46a5507-1c37-4468-9ca2-3a98513eec04 req-5924104a-a896-4de5-ac05-fff2a8ffa075 tempest-AttachVolumeTestJSON-1586863211 None] attachment_update completed successfully. Sep 28 12:15:01 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" returned: 0 in 0.560s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-quobyte-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07" released by "delete_volume" :: held 1.890s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:02 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0376861c-1308-4b89-ae45-caf906d05df9 tempest-GroupSnapshotsTest-1237001898 None] Group tempest-GroupSnapshotsTest-Group-1520453017: creating Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Created reservations ['09ac8f66-e1d1-4fbc-aa66-a47a7a1b86c9', 'bb48947c-2fec-4e44-b417-9790a58b7d1d', '04bb5992-a762-46a3-a493-47775631a846', '4360a991-cc91-4dc2-9abd-981404b09189'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:02 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0376861c-1308-4b89-ae45-caf906d05df9 tempest-GroupSnapshotsTest-1237001898 None] Group tempest-GroupSnapshotsTest-Group-1520453017: created successfully Sep 28 12:15:02 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0376861c-1308-4b89-ae45-caf906d05df9 tempest-GroupSnapshotsTest-1237001898 None] Create group completed successfully. Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:02 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:15:02 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:02 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.387s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:02 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Deleted volume successfully. Sep 28 12:15:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7339f8a0-3ae7-44b3-a682-254cf2543689 tempest-VolumeSnapshotQuotasNegativeTestJSON-1223331274 None] Lock "cinder-6c2cd7f2-f6fb-48b1-9097-5dae99de9c07-delete_volume" released by "delete_volume" :: held 2.864s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Flow 'volume_create_manager' (00aacf04-0ba8-44a4-ad44-b9905e1db45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d698c0-8141-434e-b670-296ba40baa73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d698c0-8141-434e-b670-296ba40baa73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1444509978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98f361ae-b5d7-4d84-aa93-8552a64bd7b9,host='devstack@QuobyteHD#QuobyteHD',id=0a354ba1-861e-4bb0-8166-ec438721fdee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b3cc2d68be4fe4995239aae5d21263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:05Z,use_quota=True,user_id='a2d69a30d49147818d30e9ad08be33e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f27813ea-ac09-4925-8fb9-daf7c3f265c0),volume_type_id=f27813ea-ac09-4925-8fb9-daf7c3f265c0)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03166a22-e70c-4fbf-b37d-37877cff13fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03166a22-e70c-4fbf-b37d-37877cff13fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ee7320-3640-460a-9945-bfa32d3f0555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ee7320-3640-460a-9945-bfa32d3f0555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a354ba1-861e-4bb0-8166-ec438721fdee', 'volume_name': 'volume-0a354ba1-861e-4bb0-8166-ec438721fdee', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6eee1b-25bb-4a3e-8ae2-291cf6d8cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6eee1b-25bb-4a3e-8ae2-291cf6d8cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ef67a0-f212-41f5-a0ab-27c23531897a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:04 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Volume 0a354ba1-861e-4bb0-8166-ec438721fdee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a354ba1-861e-4bb0-8166-ec438721fdee', 'volume_size': 1} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=98f361ae-b5d7-4d84-aa93-8552a64bd7b9,created_at=2026-09-28T10:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1444509978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98f361ae-b5d7-4d84-aa93-8552a64bd7b9,host='devstack@QuobyteHD#QuobyteHD',id=0a354ba1-861e-4bb0-8166-ec438721fdee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b3cc2d68be4fe4995239aae5d21263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:05Z,use_quota=True,user_id='a2d69a30d49147818d30e9ad08be33e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f27813ea-ac09-4925-8fb9-daf7c3f265c0),volume_type_id=f27813ea-ac09-4925-8fb9-daf7c3f265c0)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Creating volume 0a354ba1-861e-4bb0-8166-ec438721fdee {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:04 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:15:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:04 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee 1073741824 Sep 28 12:15:04 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:05 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee 1073741824" returned: 0 in 0.707s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:05 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee Sep 28 12:15:05 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:06 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee" returned: 0 in 0.637s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ef67a0-f212-41f5-a0ab-27c23531897a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a354ba1-861e-4bb0-8166-ec438721fdee', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c074e07e-935f-452e-8473-5e61c9325652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:06 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Volume volume-0a354ba1-861e-4bb0-8166-ec438721fdee (0a354ba1-861e-4bb0-8166-ec438721fdee): created successfully Sep 28 12:15:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c074e07e-935f-452e-8473-5e61c9325652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Flow 'volume_create_manager' (00aacf04-0ba8-44a4-ad44-b9905e1db45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9cb28f1d-5658-43ad-a30a-c83379257cc7 tempest-GroupSnapshotsTest-1237001898 None] Created volume successfully. Sep 28 12:15:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-6795d6b8-15b0-4259-8e74-f3ac1c9fd394 req-58e5b1c8-39cf-4e6f-8a02-d7861e85fd45 tempest-ServerActionsTestOtherA-484120818 None] Terminate volume connection completed successfully. Sep 28 12:15:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-6795d6b8-15b0-4259-8e74-f3ac1c9fd394 req-58e5b1c8-39cf-4e6f-8a02-d7861e85fd45 tempest-ServerActionsTestOtherA-484120818 None] Deleting attachment 6477e7fc-03c6-4aed-a3dc-e1f10fb3aa56. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Flow 'volume_create_manager' (64073668-cf23-4457-96cf-10e496831273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ace3c6-cf99-4c67-b3d9-b0546566f433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38ace3c6-cf99-4c67-b3d9-b0546566f433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-46883276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98f361ae-b5d7-4d84-aa93-8552a64bd7b9,host='devstack@QuobyteHD#QuobyteHD',id=5e69acbd-64ef-410b-9048-940265eda1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b3cc2d68be4fe4995239aae5d21263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:08Z,use_quota=True,user_id='a2d69a30d49147818d30e9ad08be33e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f27813ea-ac09-4925-8fb9-daf7c3f265c0),volume_type_id=f27813ea-ac09-4925-8fb9-daf7c3f265c0)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395bcd3-4de7-40a3-a785-0b70d0d00175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a395bcd3-4de7-40a3-a785-0b70d0d00175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e671fe4-6096-4d4c-9956-c21826936c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e671fe4-6096-4d4c-9956-c21826936c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e69acbd-64ef-410b-9048-940265eda1e4', 'volume_name': 'volume-5e69acbd-64ef-410b-9048-940265eda1e4', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45bca2a-6889-4b60-8a79-5e793453cfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45bca2a-6889-4b60-8a79-5e793453cfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe1cd5e-078f-42b7-b5fb-c9ca2e888e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:08 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Volume 5e69acbd-64ef-410b-9048-940265eda1e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e69acbd-64ef-410b-9048-940265eda1e4', 'volume_size': 1} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=98f361ae-b5d7-4d84-aa93-8552a64bd7b9,created_at=2026-09-28T10:15:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-46883276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=98f361ae-b5d7-4d84-aa93-8552a64bd7b9,host='devstack@QuobyteHD#QuobyteHD',id=5e69acbd-64ef-410b-9048-940265eda1e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b3cc2d68be4fe4995239aae5d21263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:08Z,use_quota=True,user_id='a2d69a30d49147818d30e9ad08be33e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f27813ea-ac09-4925-8fb9-daf7c3f265c0),volume_type_id=f27813ea-ac09-4925-8fb9-daf7c3f265c0)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Creating volume 5e69acbd-64ef-410b-9048-940265eda1e4 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:08 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:15:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:08 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 1073741824 Sep 28 12:15:08 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:09 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 1073741824" returned: 0 in 0.827s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:09 devstack sudo[92035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 Sep 28 12:15:09 devstack sudo[92035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-6795d6b8-15b0-4259-8e74-f3ac1c9fd394 req-3c76d573-defa-4452-96a4-a65e2b348925 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:10 devstack sudo[92035]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4" returned: 0 in 0.713s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.646s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-6795d6b8-15b0-4259-8e74-f3ac1c9fd394 req-3c76d573-defa-4452-96a4-a65e2b348925 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.276s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe1cd5e-078f-42b7-b5fb-c9ca2e888e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e69acbd-64ef-410b-9048-940265eda1e4', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff04398-7724-4486-9363-8511e6c04317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-6795d6b8-15b0-4259-8e74-f3ac1c9fd394 req-3c76d573-defa-4452-96a4-a65e2b348925 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:10 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Volume volume-5e69acbd-64ef-410b-9048-940265eda1e4 (5e69acbd-64ef-410b-9048-940265eda1e4): created successfully Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff04398-7724-4486-9363-8511e6c04317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Flow 'volume_create_manager' (64073668-cf23-4457-96cf-10e496831273) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:10 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c4358c1a-28ce-4890-9492-8b6e42a3a81d tempest-GroupSnapshotsTest-1237001898 None] Created volume successfully. Sep 28 12:15:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-6795d6b8-15b0-4259-8e74-f3ac1c9fd394 req-3c76d573-defa-4452-96a4-a65e2b348925 tempest-ServerActionsTestOtherA-484120818 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-40836eaa-154b-483d-8c4c-2d638f7fb54b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '641c0153-cf92-42bf-b0e6-d5a3c46625af', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:15:10 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-6795d6b8-15b0-4259-8e74-f3ac1c9fd394 req-3c76d573-defa-4452-96a4-a65e2b348925 tempest-ServerActionsTestOtherA-484120818 None] attachment_update completed successfully. Sep 28 12:15:11 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c8b5dc2b-d6e6-459c-9617-036058c065d9 tempest-GroupSnapshotsTest-1237001898 None] Update group completed successfully. Sep 28 12:15:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a7877e79-3e6b-47d1-a7c1-06c73a584986 tempest-GroupSnapshotsTest-1237001898 None] Update group completed successfully. Sep 28 12:15:14 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9ef0296c-8945-4938-ad42-e9ded33bde46 tempest-GroupSnapshotsTest-1237001898 None] Update group completed successfully. Sep 28 12:15:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-bf10ba51-ad6a-4c3d-bad8-f0fde76b69ef tempest-GroupSnapshotsTest-1237001898 None] Update group completed successfully. Sep 28 12:15:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] GroupSnapshot ea4c8200-c142-47b1-9db0-9d86c8b50358: creating. Sep 28 12:15:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Group snapshot ea4c8200-c142-47b1-9db0-9d86c8b50358: creating. {{(pid=87048) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 12:15:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Creating offline snapshot 5ef1aa38-14b0-4706-ae49-b846e3bd51fe of volume 5e69acbd-64ef-410b-9048-940265eda1e4 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:15:17 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cd1fac-624f-4a80-9912-53029ccfd764]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:17 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 Sep 28 12:15:17 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:18 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4" returned: 0 in 0.740s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:18 devstack sudo[92489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe 1G Sep 28 12:15:18 devstack sudo[92489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:19 devstack sudo[92489]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe 1G" returned: 0 in 0.769s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e69acbd-64ef-410b-9048-940265eda1e4 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:19 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e69acbd-64ef-410b-9048-940265eda1e4 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe Sep 28 12:15:19 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:19 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e69acbd-64ef-410b-9048-940265eda1e4 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe" returned: 0 in 0.827s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:19 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:19 devstack sudo[92501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe Sep 28 12:15:19 devstack sudo[92501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:20 devstack sudo[92501]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe" returned: 0 in 0.533s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:20 devstack sudo[92504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.info Sep 28 12:15:20 devstack sudo[92504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:20 devstack sudo[92504]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.info" returned: 0 in 0.522s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:20 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:21 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.info Sep 28 12:15:21 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:21 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.info" returned: 0 in 0.477s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:21 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=89,cinder:SELECT=115,cinder:INSERT=24,cinder:DELETE=2 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:15:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Creating offline snapshot afbb8157-d61b-4f05-aea0-96f376ea9272 of volume 0a354ba1-861e-4bb0-8166-ec438721fdee {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:15:21 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca0c3c9-8028-4479-8351-6d8b21159a22]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:21 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee Sep 28 12:15:21 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:22 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee" returned: 0 in 0.676s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:22 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 1G Sep 28 12:15:22 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:22 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 1G" returned: 0 in 0.552s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a354ba1-861e-4bb0-8166-ec438721fdee -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:22 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a354ba1-861e-4bb0-8166-ec438721fdee -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 Sep 28 12:15:22 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:23 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a354ba1-861e-4bb0-8166-ec438721fdee -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272" returned: 0 in 0.498s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:23 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:23 devstack sudo[92529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 Sep 28 12:15:23 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:23 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272" returned: 0 in 0.336s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:23 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=108,cinder:UPDATE=88,cinder:DELETE=8,cinder:INSERT=26 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:15:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:23 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.info Sep 28 12:15:23 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:24 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.info" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:24 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:24 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.info Sep 28 12:15:24 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:24 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.info" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.902s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:24 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0393c966-b074-4a3d-8e63-b44d51da0527 tempest-GroupSnapshotsTest-1237001898 None] group_snapshot ea4c8200-c142-47b1-9db0-9d86c8b50358: created successfully Sep 28 12:15:25 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] group_snapshot ea4c8200-c142-47b1-9db0-9d86c8b50358: deleting Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] group_snapshot ea4c8200-c142-47b1-9db0-9d86c8b50358: deleting {{(pid=87048) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-5e69acbd-64ef-410b-9048-940265eda1e4" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-5e69acbd-64ef-410b-9048-940265eda1e4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-5ef1aa38-14b0-4706-ae49-b846e3bd51fe" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-5ef1aa38-14b0-4706-ae49-b846e3bd51fe" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Deleting offline snapshot 5ef1aa38-14b0-4706-ae49-b846e3bd51fe of volume 5e69acbd-64ef-410b-9048-940265eda1e4 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] snapshot_file for this snap is: volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[193b11a1-7834-480a-969f-88407cbd3244]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:25 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe Sep 28 12:15:25 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Flow 'volume_create_manager' (f2cb90e4-cfc6-4850-9057-ae557d274365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b555503b-7805-41ab-bce1-3d30c5a81842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b555503b-7805-41ab-bce1-3d30c5a81842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1482227688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80f03a1-c3a9-4059-9f24-77b4bc83b4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16ed9987f24481d9cd12d0aa9aa3b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:26Z,use_quota=True,user_id='27c19f9049bc4171bd372f5bb1a8b5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c95276a-683c-4111-a8cf-1dd63f8df1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c95276a-683c-4111-a8cf-1dd63f8df1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f0422f-48f5-4f73-8842-7c2ce34cb885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6f0422f-48f5-4f73-8842-7c2ce34cb885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e80f03a1-c3a9-4059-9f24-77b4bc83b4f0', 'volume_name': 'volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a517f0c5-7808-4791-a107-0b614e0a0f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a517f0c5-7808-4791-a107-0b614e0a0f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59bf79b-f6ff-49e3-85d2-db9a61ef400f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:26 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Volume e80f03a1-c3a9-4059-9f24-77b4bc83b4f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0', 'volume_size': 1} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1482227688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e80f03a1-c3a9-4059-9f24-77b4bc83b4f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c16ed9987f24481d9cd12d0aa9aa3b4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:26Z,use_quota=True,user_id='27c19f9049bc4171bd372f5bb1a8b5bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Creating volume e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:26 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:26 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 1073741824 Sep 28 12:15:26 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:26 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe" returned: 0 in 0.612s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e69acbd-64ef-410b-9048-940265eda1e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b317582a-a77e-481d-b4b0-92758cc5e447]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:26 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 Sep 28 12:15:26 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:26 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 1073741824" returned: 0 in 0.509s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:26 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 Sep 28 12:15:26 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:26 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4" returned: 0 in 0.572s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:26 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe Sep 28 12:15:26 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:26 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59bf79b-f6ff-49e3-85d2-db9a61ef400f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cdc7da-1fe6-4c33-9f62-0bfdfd28ac34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:27 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Volume volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 (e80f03a1-c3a9-4059-9f24-77b4bc83b4f0): created successfully Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23cdc7da-1fe6-4c33-9f62-0bfdfd28ac34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Flow 'volume_create_manager' (f2cb90e4-cfc6-4850-9057-ae557d274365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-32bd5c3f-3c52-4b54-a606-dd72716c422a tempest-AbsoluteLimitsTests-1566605720 None] Created volume successfully. Sep 28 12:15:27 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe" returned: 0 in 0.462s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:27 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe Sep 28 12:15:27 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:27 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4.5ef1aa38-14b0-4706-ae49-b846e3bd51fe" returned: 0 in 0.264s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-5ef1aa38-14b0-4706-ae49-b846e3bd51fe" released by "_delete_snapshot" :: held 2.103s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-5e69acbd-64ef-410b-9048-940265eda1e4" released by "delete_snapshot" :: held 2.158s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-0a354ba1-861e-4bb0-8166-ec438721fdee" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-0a354ba1-861e-4bb0-8166-ec438721fdee" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-afbb8157-d61b-4f05-aea0-96f376ea9272" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-afbb8157-d61b-4f05-aea0-96f376ea9272" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Deleting offline snapshot afbb8157-d61b-4f05-aea0-96f376ea9272 of volume 0a354ba1-861e-4bb0-8166-ec438721fdee {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] snapshot_file for this snap is: volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e7e4e6-56f6-45f7-aee8-2990df6c6b4f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:27 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 Sep 28 12:15:27 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:28 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272" returned: 0 in 0.490s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a354ba1-861e-4bb0-8166-ec438721fdee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab20229-9079-4ea8-a631-fb95e6653439]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Acquiring lock "cinder-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Lock "cinder-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:28 devstack sudo[92601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee Sep 28 12:15:28 devstack sudo[92601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Acquiring lock "cinder-quobyte-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Lock "cinder-quobyte-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0" acquired by "delete_volume" :: waited 0.029s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[be599d95-7dcf-45eb-ad8d-5a68e1e1766d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:28 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 Sep 28 12:15:28 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:28 devstack sudo[92601]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee" returned: 0 in 0.593s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:28 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 Sep 28 12:15:28 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:29 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0" returned: 0 in 0.542s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:29 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0 Sep 28 12:15:29 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:29 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272" returned: 0 in 0.406s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:29 devstack sudo[92622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272 Sep 28 12:15:29 devstack sudo[92622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:29 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0" returned: 0 in 0.275s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Lock "cinder-quobyte-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0" released by "delete_volume" :: held 0.887s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Created reservations ['e61e5a71-22ca-4f0e-836b-2967f53e956f', 'a55fed21-45b5-448f-970e-c56d1217d69e', '639b1bef-228e-4776-a1a9-3b08e1d2e32e', 'fe0e704e-f2e8-491b-8cd4-3a095feb0b4b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:29 devstack sudo[92622]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee.afbb8157-d61b-4f05-aea0-96f376ea9272" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-afbb8157-d61b-4f05-aea0-96f376ea9272" released by "_delete_snapshot" :: held 1.919s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-0a354ba1-861e-4bb0-8166-ec438721fdee" released by "delete_snapshot" :: held 1.948s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:29 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:15:29 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:29 devstack cinder-volume[87048]: WARNING cinder.quota [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-501400344 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-501400344, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:29 devstack cinder-volume[87048]: WARNING cinder.quota [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-501400344 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-501400344, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['4932ddf9-7008-40f2-a05a-194644fc16bc', 'fdc4888f-7fda-49dd-bf56-50bf6aa177eb', '612de4db-e6d9-4efb-a8db-a9a49ee94407', '2b0a8d43-7f65-4260-98f3-14610f3c9d31'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:29 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.304s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Deleted volume successfully. Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['fa8113f3-e60c-41c0-93de-217c80108253', 'd2bcff0e-b6db-4c27-8a19-7dd7cf59c93d', '8f235531-a6bd-4068-8b7c-5ff0f5e28ff8', 'a3e094d0-836b-4761-8bf5-6ba6eaf4c564'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e55fefd-dd90-4ee7-96c6-3cc9d6dda504 tempest-AbsoluteLimitsTests-1566605720 None] Lock "cinder-e80f03a1-c3a9-4059-9f24-77b4bc83b4f0-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b49ac1f5-9109-4b6e-8466-03a48f1570f9 tempest-GroupSnapshotsTest-1237001898 None] group_snapshot ea4c8200-c142-47b1-9db0-9d86c8b50358: deleted successfully Sep 28 12:15:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-0a354ba1-861e-4bb0-8166-ec438721fdee" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-0a354ba1-861e-4bb0-8166-ec438721fdee" acquired by "delete_volume" :: waited 0.029s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:30 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d1036a-6028-4747-9684-898898639e1b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:30 devstack sudo[92629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee Sep 28 12:15:30 devstack sudo[92629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:31 devstack sudo[92629]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee" returned: 0 in 0.409s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:31 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee Sep 28 12:15:31 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:31 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0a354ba1-861e-4bb0-8166-ec438721fdee" returned: 0 in 0.330s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-0a354ba1-861e-4bb0-8166-ec438721fdee" released by "delete_volume" :: held 0.828s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-5e69acbd-64ef-410b-9048-940265eda1e4" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-5e69acbd-64ef-410b-9048-940265eda1e4" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[12edcc6f-4526-4beb-8b08-a6edd5b941cb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:31 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 Sep 28 12:15:31 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:32 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4" returned: 0 in 0.505s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:32 devstack sudo[92642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4 Sep 28 12:15:32 devstack sudo[92642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:32 devstack sudo[92642]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5e69acbd-64ef-410b-9048-940265eda1e4" returned: 0 in 0.357s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-5e69acbd-64ef-410b-9048-940265eda1e4" released by "delete_volume" :: held 0.953s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['bf5d7f43-fb65-47ae-920d-179e38dfe6d4'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:32 devstack cinder-volume[87048]: WARNING cinder.quota [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-501400344 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-501400344, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['9cd802ea-b1f5-4e2f-a5ae-31b24f0e2b3d', '12a4273d-1843-4268-9695-27bd5d8a7429', '9cce13f9-3dd3-47c5-b728-02bedb26f8db', 'e4203589-1660-4594-9429-ec1b8a29a741'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['c1f831e3-b653-4448-a14c-23130465a263', '1a2b3d5b-2cf7-41e2-bc18-e4789bc7ab4a', '5141a537-08ee-47bd-ad04-7d76cb9f9de0', '1bf24371-6f4b-49cb-9b15-7ba72ef35f61'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:33 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:15:33 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:33 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.334s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:33 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e13b3770-01a7-4a13-9bb8-9dfde0e5efd6 tempest-GroupSnapshotsTest-1237001898 None] Delete group completed successfully. Sep 28 12:15:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1a7c0db0-ac75-4fc1-bd5a-d9a3a28136d8 tempest-GroupSnapshotsTest-1237001898 None] Group tempest-GroupSnapshotsTest-Group-1831594510: creating Sep 28 12:15:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1a7c0db0-ac75-4fc1-bd5a-d9a3a28136d8 tempest-GroupSnapshotsTest-1237001898 None] Group tempest-GroupSnapshotsTest-Group-1831594510: created successfully Sep 28 12:15:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1a7c0db0-ac75-4fc1-bd5a-d9a3a28136d8 tempest-GroupSnapshotsTest-1237001898 None] Create group completed successfully. Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (77762e0f-f061-40f7-8390-7145b7a245ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88544d3d-12d5-451f-8f2a-2f3fcf6a0ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88544d3d-12d5-451f-8f2a-2f3fcf6a0ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1033938121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31400085-e8da-4519-a468-9c1ac6570749,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:36Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390ec6d2-bebc-4cc0-aa05-a298ddbed68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (390ec6d2-bebc-4cc0-aa05-a298ddbed68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6099ea79-2225-4cd2-a862-b6c08bccfc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6099ea79-2225-4cd2-a862-b6c08bccfc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31400085-e8da-4519-a468-9c1ac6570749', 'volume_name': 'volume-31400085-e8da-4519-a468-9c1ac6570749', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28b5bd3-6ef0-4cb3-956d-a6acda02ee99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a28b5bd3-6ef0-4cb3-956d-a6acda02ee99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff23ff57-fdd0-44d8-8dea-f36ad2edcbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:35 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Volume 31400085-e8da-4519-a468-9c1ac6570749: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31400085-e8da-4519-a468-9c1ac6570749', 'volume_size': 1} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1033938121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31400085-e8da-4519-a468-9c1ac6570749,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:36Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Creating volume 31400085-e8da-4519-a468-9c1ac6570749 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:35 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:15:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:36 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749 1073741824 Sep 28 12:15:36 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Flow 'volume_create_manager' (960d5ece-af5a-4642-a1c1-25b00652df25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3652cab3-9f03-486c-ba49-91580aeb9d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3652cab3-9f03-486c-ba49-91580aeb9d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126934896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=431b841c-ccb2-494c-ab8c-02aa214281ff,host='devstack@QuobyteHD#QuobyteHD',id=e4b68a6b-ee2f-4719-8351-43be525956f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b3cc2d68be4fe4995239aae5d21263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:36Z,use_quota=True,user_id='a2d69a30d49147818d30e9ad08be33e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dd1a50-d04c-4d51-b1f9-3d3dc9499632),volume_type_id=68dd1a50-d04c-4d51-b1f9-3d3dc9499632)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0813d83f-6153-4111-af0e-5adc51877b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0813d83f-6153-4111-af0e-5adc51877b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df2291a-9da2-48ca-9dab-5aaa8fa67189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df2291a-9da2-48ca-9dab-5aaa8fa67189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4b68a6b-ee2f-4719-8351-43be525956f1', 'volume_name': 'volume-e4b68a6b-ee2f-4719-8351-43be525956f1', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362ba6c6-9f6b-4496-b99b-944eb74a7d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362ba6c6-9f6b-4496-b99b-944eb74a7d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe68a44f-87c9-4697-b973-6f8325fff145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:36 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Volume e4b68a6b-ee2f-4719-8351-43be525956f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4b68a6b-ee2f-4719-8351-43be525956f1', 'volume_size': 1} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:36 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749 1073741824" returned: 0 in 0.586s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:36 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749 Sep 28 12:15:36 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:36 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749" returned: 0 in 0.258s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.302s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=431b841c-ccb2-494c-ab8c-02aa214281ff,created_at=2026-09-28T10:15:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2126934896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=431b841c-ccb2-494c-ab8c-02aa214281ff,host='devstack@QuobyteHD#QuobyteHD',id=e4b68a6b-ee2f-4719-8351-43be525956f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84b3cc2d68be4fe4995239aae5d21263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:36Z,use_quota=True,user_id='a2d69a30d49147818d30e9ad08be33e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(68dd1a50-d04c-4d51-b1f9-3d3dc9499632),volume_type_id=68dd1a50-d04c-4d51-b1f9-3d3dc9499632)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Creating volume e4b68a6b-ee2f-4719-8351-43be525956f1 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:36 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff23ff57-fdd0-44d8-8dea-f36ad2edcbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31400085-e8da-4519-a468-9c1ac6570749', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd9d46c-9403-4c2b-94b0-dc24efc0c327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:36 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 1073741824 Sep 28 12:15:36 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:36 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Volume volume-31400085-e8da-4519-a468-9c1ac6570749 (31400085-e8da-4519-a468-9c1ac6570749): created successfully Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd9d46c-9403-4c2b-94b0-dc24efc0c327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (77762e0f-f061-40f7-8390-7145b7a245ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:36 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-beeab53d-ff20-47ea-b87a-869f454cfa7f tempest-VolumesGetTest-431672013 None] Created volume successfully. Sep 28 12:15:37 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 1073741824" returned: 0 in 0.458s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:37 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 Sep 28 12:15:37 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:37 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1" returned: 0 in 0.330s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe68a44f-87c9-4697-b973-6f8325fff145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4b68a6b-ee2f-4719-8351-43be525956f1', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8108f2f-bb5f-402d-80d4-595fc0a71ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:37 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Volume volume-e4b68a6b-ee2f-4719-8351-43be525956f1 (e4b68a6b-ee2f-4719-8351-43be525956f1): created successfully Sep 28 12:15:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8108f2f-bb5f-402d-80d4-595fc0a71ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Flow 'volume_create_manager' (960d5ece-af5a-4642-a1c1-25b00652df25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:37 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ea616c69-a200-4b08-9750-54703849079a tempest-GroupSnapshotsTest-1237001898 None] Created volume successfully. Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:38 devstack sudo[92678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:15:38 devstack sudo[92678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-30a2de14-8fec-4c23-a6b9-1c2cbde9c49e req-06782f18-01a3-49a8-bd49-25669360491e tempest-AttachVolumeTestJSON-1586863211 None] Terminate volume connection completed successfully. Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-30a2de14-8fec-4c23-a6b9-1c2cbde9c49e req-06782f18-01a3-49a8-bd49-25669360491e tempest-AttachVolumeTestJSON-1586863211 None] Deleting attachment afdd7d72-479e-4ded-a579-97dcdd42fb7c. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:15:38 devstack sudo[92678]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.287s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (caa67ffa-5e66-4ac9-8e98-e1f321b770de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e42fb26-f2fe-4fc1-a144-6c9bcb86bf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e42fb26-f2fe-4fc1-a144-6c9bcb86bf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1270309806',display_name='tempest-VolumesGetTest-Volume-506944241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd06411b-0d39-4559-91d4-9f9e6912c772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:39Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c39365-448d-4982-8a65-7e893f599a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c39365-448d-4982-8a65-7e893f599a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a596ab4-a34c-4285-ac7f-c483048d8ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a596ab4-a34c-4285-ac7f-c483048d8ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd06411b-0d39-4559-91d4-9f9e6912c772', 'volume_name': 'volume-bd06411b-0d39-4559-91d4-9f9e6912c772', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce66e00-8539-4136-87a9-ecb1416e9928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ce66e00-8539-4136-87a9-ecb1416e9928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b94e7a-d016-42fb-9dfa-c6f210de68c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:38 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Volume bd06411b-0d39-4559-91d4-9f9e6912c772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd06411b-0d39-4559-91d4-9f9e6912c772', 'volume_size': 1} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:39Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1270309806',display_name='tempest-VolumesGetTest-Volume-506944241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd06411b-0d39-4559-91d4-9f9e6912c772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:39Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Creating volume bd06411b-0d39-4559-91d4-9f9e6912c772 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:39 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:39 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772 1073741824 Sep 28 12:15:39 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] GroupSnapshot e5838852-9aca-42e4-83c3-9be8df642832: creating. Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Group snapshot e5838852-9aca-42e4-83c3-9be8df642832: creating. {{(pid=87048) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:39 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772 1073741824" returned: 0 in 0.565s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:39 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772 Sep 28 12:15:39 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:39 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772" returned: 0 in 0.248s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.549s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5b94e7a-d016-42fb-9dfa-c6f210de68c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd06411b-0d39-4559-91d4-9f9e6912c772', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7f1a8a-81f2-44ba-a69c-d0c17cee11a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Creating offline snapshot f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 of volume e4b68a6b-ee2f-4719-8351-43be525956f1 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:15:39 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Volume volume-bd06411b-0d39-4559-91d4-9f9e6912c772 (bd06411b-0d39-4559-91d4-9f9e6912c772): created successfully Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7f1a8a-81f2-44ba-a69c-d0c17cee11a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (caa67ffa-5e66-4ac9-8e98-e1f321b770de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a90717c-d74c-4cb4-8d69-0f95a205bc6f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-143432d2-09be-40f9-86fb-ac3574b5d31c tempest-VolumesGetTest-431672013 None] Created volume successfully. Sep 28 12:15:40 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 Sep 28 12:15:40 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:40 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1" returned: 0 in 0.387s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:40 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 1G Sep 28 12:15:40 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:40 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 1G" returned: 0 in 0.502s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b68a6b-ee2f-4719-8351-43be525956f1 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:40 devstack sudo[92712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b68a6b-ee2f-4719-8351-43be525956f1 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 Sep 28 12:15:40 devstack sudo[92712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-bd06411b-0d39-4559-91d4-9f9e6912c772-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Lock "cinder-bd06411b-0d39-4559-91d4-9f9e6912c772-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-quobyte-bd06411b-0d39-4559-91d4-9f9e6912c772" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-bd06411b-0d39-4559-91d4-9f9e6912c772" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0863c55-5c8a-4e11-a7bd-0ee824576009]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:41 devstack sudo[92712]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4b68a6b-ee2f-4719-8351-43be525956f1 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97" returned: 0 in 0.418s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:41 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:41 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 Sep 28 12:15:41 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:41 devstack sudo[92719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772 Sep 28 12:15:41 devstack sudo[92719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:41 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97" returned: 0 in 0.270s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:41 devstack sudo[92725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.info Sep 28 12:15:41 devstack sudo[92725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:41 devstack sudo[92719]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772" returned: 0 in 0.639s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:41 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772 Sep 28 12:15:41 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:42 devstack sudo[92725]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.info" returned: 0 in 0.539s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:42 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:42 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.info Sep 28 12:15:42 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:42 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-bd06411b-0d39-4559-91d4-9f9e6912c772" returned: 0 in 0.567s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-bd06411b-0d39-4559-91d4-9f9e6912c772" released by "delete_volume" :: held 1.280s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:42 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.info" returned: 0 in 0.453s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.703s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Created reservations ['12b519a4-7a82-48e5-9e7d-6e074adf850d', 'd29de0cb-86c9-4638-bd44-8adec7cd9f91', '071163eb-23e7-4286-b4fa-b3dc574086fe', '140f23b7-e33f-44fe-aa7d-2bc7722bd3fb'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:42 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3cfd14b6-b40b-4324-9dab-ca4d2503371e tempest-GroupSnapshotsTest-1237001898 None] group_snapshot e5838852-9aca-42e4-83c3-9be8df642832: created successfully Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:42 devstack sudo[92764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:15:42 devstack sudo[92764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:43 devstack sudo[92764]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.522s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:43 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Deleted volume successfully. Sep 28 12:15:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8fb41d1f-6d9c-4354-b1d9-bf24f6c038be tempest-VolumesGetTest-431672013 None] Lock "cinder-bd06411b-0d39-4559-91d4-9f9e6912c772-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-31400085-e8da-4519-a468-9c1ac6570749-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Lock "cinder-31400085-e8da-4519-a468-9c1ac6570749-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-quobyte-31400085-e8da-4519-a468-9c1ac6570749" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-31400085-e8da-4519-a468-9c1ac6570749" acquired by "delete_volume" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:43 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34561d4-ab54-4dba-aee9-56f7f2f8bb9d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] group_snapshot e5838852-9aca-42e4-83c3-9be8df642832: deleting Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] group_snapshot e5838852-9aca-42e4-83c3-9be8df642832: deleting {{(pid=87048) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-e4b68a6b-ee2f-4719-8351-43be525956f1" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:44 devstack sudo[92820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749 Sep 28 12:15:44 devstack sudo[92820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-e4b68a6b-ee2f-4719-8351-43be525956f1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-f85c8c2d-97c2-42b3-9716-ec7ebba0bb97" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-f85c8c2d-97c2-42b3-9716-ec7ebba0bb97" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Deleting offline snapshot f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 of volume e4b68a6b-ee2f-4719-8351-43be525956f1 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] snapshot_file for this snap is: volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[92398bfb-e9c9-4f55-b4e9-6bd6f8f830a0]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:44 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 Sep 28 12:15:44 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:44 devstack sudo[92820]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749" returned: 0 in 0.746s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:44 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749 Sep 28 12:15:44 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:44 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97" returned: 0 in 0.553s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4b68a6b-ee2f-4719-8351-43be525956f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e919df-7605-4515-ab45-037467b5bc5a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:45 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31400085-e8da-4519-a468-9c1ac6570749" returned: 0 in 0.396s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-31400085-e8da-4519-a468-9c1ac6570749" released by "delete_volume" :: held 1.237s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:45 devstack sudo[92874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 Sep 28 12:15:45 devstack sudo[92874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Created reservations ['43cbca3b-0ba5-47f7-b256-073b96c3279e', '5dee598b-9118-4eec-881b-4b83683fd9a3', '83b5aab6-5f8c-493c-b3d9-118fad2d75f9', '062e3bc1-ed9b-4357-8291-c7e8f9c4a045'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:45 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:15:45 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:45 devstack sudo[92874]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1" returned: 0 in 0.517s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:45 devstack sudo[92883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 Sep 28 12:15:45 devstack sudo[92883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:45 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.323s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Deleted volume successfully. Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d045c3e-2703-49e9-a5a6-c1ab5a3e6a43 tempest-VolumesGetTest-431672013 None] Lock "cinder-31400085-e8da-4519-a468-9c1ac6570749-delete_volume" released by "delete_volume" :: held 1.909s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:45 devstack sudo[92883]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97" returned: 0 in 0.420s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:45 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97 Sep 28 12:15:45 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:46 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1.f85c8c2d-97c2-42b3-9716-ec7ebba0bb97" returned: 0 in 0.356s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-f85c8c2d-97c2-42b3-9716-ec7ebba0bb97" released by "_delete_snapshot" :: held 2.048s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-e4b68a6b-ee2f-4719-8351-43be525956f1" released by "delete_snapshot" :: held 2.095s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:46 devstack cinder-volume[87048]: WARNING cinder.quota [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-319528834 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-319528834, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:46 devstack cinder-volume[87048]: WARNING cinder.quota [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-319528834 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-319528834, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['90108c29-3954-4824-ac91-dd2b28c600f2', 'd77b190b-7c7f-4acc-a821-c1215e85788c', 'df868751-315d-4de9-a700-76bd0b6c13a6', 'a09a8ab2-c72b-495c-9d51-feff8fe7bf03'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-741f08d2-fbaa-4f33-b441-25606774fb8d tempest-GroupSnapshotsTest-1237001898 None] group_snapshot e5838852-9aca-42e4-83c3-9be8df642832: deleted successfully Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (2e0a76e7-2c3f-485b-b4df-d93b133aad89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3159f225-dd1b-48c3-a024-c7ff44603446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3159f225-dd1b-48c3-a024-c7ff44603446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-559790140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbce0b42-3b9a-464b-b1c1-646984198d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:47Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172b16be-3390-42a3-a9f1-d460c8b0d106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (172b16be-3390-42a3-a9f1-d460c8b0d106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b688ac-f24c-48ab-9d08-70ad773c6776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4b688ac-f24c-48ab-9d08-70ad773c6776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbce0b42-3b9a-464b-b1c1-646984198d70', 'volume_name': 'volume-fbce0b42-3b9a-464b-b1c1-646984198d70', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3913282-89fb-46f0-b659-c198379fe123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3913282-89fb-46f0-b659-c198379fe123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a770584-ce45-411f-a606-686468610271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:46 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Volume fbce0b42-3b9a-464b-b1c1-646984198d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbce0b42-3b9a-464b-b1c1-646984198d70', 'volume_size': 1} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-559790140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbce0b42-3b9a-464b-b1c1-646984198d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:47Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Creating volume fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:15:46 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:46 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 1073741824 Sep 28 12:15:46 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "cinder-quobyte-e4b68a6b-ee2f-4719-8351-43be525956f1" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-e4b68a6b-ee2f-4719-8351-43be525956f1" acquired by "delete_volume" :: waited 0.037s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[acefbd98-e8c5-434d-88cf-f9fe3d87736a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:47 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 Sep 28 12:15:47 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:47 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 1073741824" returned: 0 in 0.652s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:47 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 Sep 28 12:15:47 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:47 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1" returned: 0 in 0.476s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:47 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1 Sep 28 12:15:47 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:47 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70" returned: 0 in 0.317s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:47 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a770584-ce45-411f-a606-686468610271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbce0b42-3b9a-464b-b1c1-646984198d70', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500872e9-b8c8-4341-9dd3-482f481fa608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4b68a6b-ee2f-4719-8351-43be525956f1" returned: 0 in 0.297s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:47 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Volume volume-fbce0b42-3b9a-464b-b1c1-646984198d70 (fbce0b42-3b9a-464b-b1c1-646984198d70): created successfully Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500872e9-b8c8-4341-9dd3-482f481fa608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (2e0a76e7-2c3f-485b-b4df-d93b133aad89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Lock "cinder-quobyte-e4b68a6b-ee2f-4719-8351-43be525956f1" released by "delete_volume" :: held 0.888s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:15:47 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-34a2cc7e-6637-4801-8438-0f9c37998907 tempest-VolumesGetTest-431672013 None] Created volume successfully. Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['a5ee4d57-74b5-4ece-a626-da6ddc850e8a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:47 devstack cinder-volume[87048]: WARNING cinder.quota [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-319528834 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-319528834, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:15:47 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Created reservations ['6875327a-b213-42e2-bcb7-29909921a993', '69f8cab5-ce88-4835-bdcb-5a03803cb80d', '9dbbb57e-6686-4208-8486-b1b10b984fcc', 'b589f825-6859-437e-95ba-cf11e6141124'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:15:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:48 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:15:48 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:48 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:48 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:15:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b0ce2b09-d2db-401b-8922-1799382d169d tempest-GroupSnapshotsTest-1237001898 None] Delete group completed successfully. Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (6747f404-8b5a-4bc8-84ac-1a5d144765b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df3ebd9-8eac-4284-902b-ae8f948889f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df3ebd9-8eac-4284-902b-ae8f948889f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1265773359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e514383-66b0-48d1-a8bf-72ff992a3027,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=fbce0b42-3b9a-464b-b1c1-646984198d70,status='creating',terminated_at=None,updated_at=2026-09-28T10:15:49Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306350c1-68fe-465f-8b6f-c59c50d4ca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306350c1-68fe-465f-8b6f-c59c50d4ca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450aa4d3-56a3-47d0-a522-4323e58914a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450aa4d3-56a3-47d0-a522-4323e58914a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4e514383-66b0-48d1-a8bf-72ff992a3027', 'volume_name': 'volume-4e514383-66b0-48d1-a8bf-72ff992a3027', 'volume_size': 1, 'source_volid': 'fbce0b42-3b9a-464b-b1c1-646984198d70', 'source_volstatus': 'available'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a9d449-1bc9-451f-9fd2-2d77117651b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a9d449-1bc9-451f-9fd2-2d77117651b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d42ce05-a02e-4f7e-9228-a78e66f38bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:15:49 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Volume 4e514383-66b0-48d1-a8bf-72ff992a3027: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4e514383-66b0-48d1-a8bf-72ff992a3027', 'volume_size': 1, 'source_volid': 'fbce0b42-3b9a-464b-b1c1-646984198d70', 'source_volstatus': 'available'} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:49 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Cloning volume fbce0b42-3b9a-464b-b1c1-646984198d70 to volume 4e514383-66b0-48d1-a8bf-72ff992a3027 Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Creating offline snapshot d58b6ae2-a971-4328-913a-dbaf889bf9e8 of volume fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b112cbb-680f-42ed-a383-587eb957326c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:49 devstack sudo[92918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 Sep 28 12:15:49 devstack sudo[92918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:49 devstack sudo[92918]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70" returned: 0 in 0.444s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:49 devstack sudo[92924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 1G Sep 28 12:15:49 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:50 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 1G" returned: 0 in 0.495s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbce0b42-3b9a-464b-b1c1-646984198d70 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:50 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbce0b42-3b9a-464b-b1c1-646984198d70 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 Sep 28 12:15:50 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:50 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbce0b42-3b9a-464b-b1c1-646984198d70 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8" returned: 0 in 0.436s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:50 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 is being set with open permissions: ugo+rw Sep 28 12:15:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:50 devstack sudo[92969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 Sep 28 12:15:50 devstack sudo[92969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:51 devstack sudo[92969]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8" returned: 0 in 0.325s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:51 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.info Sep 28 12:15:51 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:51 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.info" returned: 0 in 0.361s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:51 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.info is being set with open permissions: ugo+rw Sep 28 12:15:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:51 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.info Sep 28 12:15:51 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:51 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.info" returned: 0 in 0.386s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-quobyte-4e514383-66b0-48d1-a8bf-72ff992a3027" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-4e514383-66b0-48d1-a8bf-72ff992a3027" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] snapshot: d58b6ae2-a971-4328-913a-dbaf889bf9e8, volume: 4e514383-66b0-48d1-a8bf-72ff992a3027, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe21f92c-9ca3-44aa-bb7a-2294d5d7236c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:52 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 Sep 28 12:15:52 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:52 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8" returned: 0 in 0.468s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbce0b42-3b9a-464b-b1c1-646984198d70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[52552b7c-5e55-4be2-bd51-29402a1df162]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:15:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:52 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 Sep 28 12:15:52 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:15:53 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 28 12:15:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70" returned: 0 in 0.471s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:15:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:15:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:15:53 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:15:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:15:53 devstack sudo[92991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 Sep 28 12:15:53 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:01 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=86,cinder:UPDATE=86,cinder:DELETE=5,cinder:INSERT=20 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:16:01 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=102,cinder:SELECT=77,cinder:INSERT=27,cinder:DELETE=3 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:16:02 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027" returned: 0 in 9.292s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70, size 1024.00 MB, duration 9.29 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:16:02 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Converted 1024.00 MB image at 110.18 MB/s Sep 28 12:16:02 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 is being set with open permissions: ugo+rw Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:02 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 Sep 28 12:16:02 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:02 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-04173501-2e00-4451-80f9-d6b00524f675 req-555c78f0-eb69-442a-885a-760bcd1f24ff tempest-ServerActionsTestOtherA-484120818 None] Terminate volume connection completed successfully. Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-04173501-2e00-4451-80f9-d6b00524f675 req-555c78f0-eb69-442a-885a-760bcd1f24ff tempest-ServerActionsTestOtherA-484120818 None] Deleting attachment 641c0153-cf92-42bf-b0e6-d5a3c46625af. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:16:02 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027" returned: 0 in 0.390s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-4e514383-66b0-48d1-a8bf-72ff992a3027" released by "_copy_volume_from_snapshot" :: held 10.723s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-quobyte-d58b6ae2-a971-4328-913a-dbaf889bf9e8" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-d58b6ae2-a971-4328-913a-dbaf889bf9e8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Deleting offline snapshot d58b6ae2-a971-4328-913a-dbaf889bf9e8 of volume fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] snapshot_file for this snap is: volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "cinder-40836eaa-154b-483d-8c4c-2d638f7fb54b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fad2dd-5d67-4fb6-ab17-9330ebf31758]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Lock "cinder-40836eaa-154b-483d-8c4c-2d638f7fb54b-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "cinder-quobyte-40836eaa-154b-483d-8c4c-2d638f7fb54b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Lock "cinder-quobyte-40836eaa-154b-483d-8c4c-2d638f7fb54b" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:03 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5322e916-56bc-4b7c-8d78-1861fcbc4e82]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:03 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:03 devstack sudo[93071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b Sep 28 12:16:03 devstack sudo[93071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:03 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8" returned: 0 in 0.600s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbce0b42-3b9a-464b-b1c1-646984198d70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0d0103-84f8-4d2f-9e8f-407abafcb57c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:03 devstack sudo[93071]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b" returned: 0 in 0.517s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:03 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b Sep 28 12:16:03 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:03 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 Sep 28 12:16:03 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:03 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-40836eaa-154b-483d-8c4c-2d638f7fb54b" returned: 0 in 0.300s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Lock "cinder-quobyte-40836eaa-154b-483d-8c4c-2d638f7fb54b" released by "delete_volume" :: held 0.891s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:03 devstack cinder-volume[87048]: DEBUG cinder.quota [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Created reservations ['46e3090d-fc79-4d2a-91bb-2cde4293ff48', 'f5314efe-3819-40d5-914e-52f421c3d253', '93fb362a-ad78-4eda-97c0-83d688c60c68', 'd8622fcc-c01d-4896-9395-3b3c15c940c6'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:04 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:16:04 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:04 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70" returned: 0 in 0.710s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:04 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 Sep 28 12:16:04 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:04 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "cinder-0e4866d7-ca08-4ac0-9a13-f3a618e624c9-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.334s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG cinder.manager [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Deleted volume successfully. Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Lock "cinder-0e4866d7-ca08-4ac0-9a13-f3a618e624c9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-04173501-2e00-4451-80f9-d6b00524f675 req-ace9d764-1178-417b-ab6c-9cb818834464 tempest-ServerActionsTestOtherA-484120818 None] Lock "cinder-40836eaa-154b-483d-8c4c-2d638f7fb54b-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "cinder-quobyte-0e4866d7-ca08-4ac0-9a13-f3a618e624c9" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Lock "cinder-quobyte-0e4866d7-ca08-4ac0-9a13-f3a618e624c9" acquired by "delete_volume" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3313a31a-12b5-49fd-a82a-c6824b74bcfe]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:04 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8" returned: 0 in 0.429s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:04 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 Sep 28 12:16:04 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:04 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8 Sep 28 12:16:04 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:04 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70.d58b6ae2-a971-4328-913a-dbaf889bf9e8" returned: 0 in 0.306s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:04 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9" returned: 0 in 0.455s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-d58b6ae2-a971-4328-913a-dbaf889bf9e8" released by "_delete_snapshot" :: held 2.195s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:04 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9 Sep 28 12:16:04 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.608s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d42ce05-a02e-4f7e-9228-a78e66f38bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e514383-66b0-48d1-a8bf-72ff992a3027', 'volume_size': 1, 'source_volid': 'fbce0b42-3b9a-464b-b1c1-646984198d70', 'source_volstatus': 'available'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec31df3d-e5fa-43d1-92b0-3a4343b94311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Volume volume-4e514383-66b0-48d1-a8bf-72ff992a3027 (4e514383-66b0-48d1-a8bf-72ff992a3027): created successfully Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec31df3d-e5fa-43d1-92b0-3a4343b94311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (6747f404-8b5a-4bc8-84ac-1a5d144765b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:05 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b80d9500-7cf3-4966-abde-99d744223db4 tempest-VolumesGetTest-431672013 None] Created volume successfully. Sep 28 12:16:05 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e4866d7-ca08-4ac0-9a13-f3a618e624c9" returned: 0 in 0.265s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Lock "cinder-quobyte-0e4866d7-ca08-4ac0-9a13-f3a618e624c9" released by "delete_volume" :: held 0.767s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Created reservations ['864defca-0c2d-4354-aed3-814c32c42fca', 'fedebed2-5e6a-4ba5-91b6-dabf40fbf04f', '605514bd-2741-4d35-8fba-75ae7aac52ac', 'de45cbfe-fa52-4330-a7e6-ac76e0ebc173'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:05 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:16:05 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:05 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.278s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:05 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Deleted volume successfully. Sep 28 12:16:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0e5e93bc-4ebb-4db7-a80f-16f4beb81f43 tempest-ServerActionsTestOtherA-484120818 None] Lock "cinder-0e4866d7-ca08-4ac0-9a13-f3a618e624c9-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (de6739b1-64c0-4ecc-bd2c-755d3efcee3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f45dcac-8dbd-4f52-bb55-c0368b9999fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f45dcac-8dbd-4f52-bb55-c0368b9999fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-737383440',display_name='tempest-VolumesGetTest-Volume-1966517058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109e1f60-9c3f-4e2c-a55a-5df2e7b782b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:07Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de02bfd-023b-4acf-b043-44616725b0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de02bfd-023b-4acf-b043-44616725b0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf391b9-14f6-4897-9b46-75bd16d7b6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf391b9-14f6-4897-9b46-75bd16d7b6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '109e1f60-9c3f-4e2c-a55a-5df2e7b782b3', 'volume_name': 'volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc066fe-7e18-431f-b62c-ee1e71ca30a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc066fe-7e18-431f-b62c-ee1e71ca30a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9ea49b-05e4-4420-b211-bd4c697e684b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:07 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Volume 109e1f60-9c3f-4e2c-a55a-5df2e7b782b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3', 'volume_size': 1} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-737383440',display_name='tempest-VolumesGetTest-Volume-1966517058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=109e1f60-9c3f-4e2c-a55a-5df2e7b782b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:07Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Creating volume 109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:07 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:07 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 1073741824 Sep 28 12:16:07 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:07 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 1073741824" returned: 0 in 0.761s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:08 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 Sep 28 12:16:08 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:08 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3" returned: 0 in 0.319s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e9ea49b-05e4-4420-b211-bd4c697e684b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed695d50-55b4-47d4-b0e1-467d237dbc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:08 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Volume volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 (109e1f60-9c3f-4e2c-a55a-5df2e7b782b3): created successfully Sep 28 12:16:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed695d50-55b4-47d4-b0e1-467d237dbc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (de6739b1-64c0-4ecc-bd2c-755d3efcee3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:08 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-55ee4158-ba5e-4340-841f-2e97a52a66c2 tempest-VolumesGetTest-431672013 None] Created volume successfully. Sep 28 12:16:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Lock "cinder-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-quobyte-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:09 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1256ae2-0f66-48b6-895a-38f8da67297f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:09 devstack sudo[93150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 Sep 28 12:16:09 devstack sudo[93150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:09 devstack sudo[93150]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3" returned: 0 in 0.431s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:09 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3 Sep 28 12:16:09 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:10 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3" returned: 0 in 0.303s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3" released by "delete_volume" :: held 0.798s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Created reservations ['38a22c34-0d40-40cb-b2bf-ee4966c3e7e7', '76cdf8d9-5087-4816-a224-ca36427332df', '2995cad9-973b-4a52-94b2-2748137714dd', 'c42266c7-928a-4dc3-bbf7-e1e34c8d966d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:10 devstack sudo[93158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:16:10 devstack sudo[93158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-4e514383-66b0-48d1-a8bf-72ff992a3027-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Lock "cinder-4e514383-66b0-48d1-a8bf-72ff992a3027-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:10 devstack sudo[93158]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.309s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:10 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Deleted volume successfully. Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-quobyte-4e514383-66b0-48d1-a8bf-72ff992a3027" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-4e514383-66b0-48d1-a8bf-72ff992a3027" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-03f9c451-60d4-4e3e-8506-47ecea1d3781 tempest-VolumesGetTest-431672013 None] Lock "cinder-109e1f60-9c3f-4e2c-a55a-5df2e7b782b3-delete_volume" released by "delete_volume" :: held 1.397s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[795fd0b6-d483-4f62-9fe6-0059598dbbd9]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:10 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 Sep 28 12:16:10 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:11 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027" returned: 0 in 0.510s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:11 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027 Sep 28 12:16:11 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:11 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4e514383-66b0-48d1-a8bf-72ff992a3027" returned: 0 in 0.276s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-4e514383-66b0-48d1-a8bf-72ff992a3027" released by "delete_volume" :: held 0.849s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Created reservations ['3033a785-df1f-47cd-a7c5-844bae505792', '4177a85d-1db0-41e7-b168-ed4d68c93185', '42ea644a-8c9f-466c-9b54-ef7d384f6811', '7e19834c-f790-4f8e-a457-ca724b5514c6'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:11 devstack sudo[93170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:16:11 devstack sudo[93170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-fbce0b42-3b9a-464b-b1c1-646984198d70-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Lock "cinder-fbce0b42-3b9a-464b-b1c1-646984198d70-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-quobyte-fbce0b42-3b9a-464b-b1c1-646984198d70" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-fbce0b42-3b9a-464b-b1c1-646984198d70" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de7afbe-8d6a-4a3c-bf06-cd0dec3eb9a3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:12 devstack sudo[93170]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.466s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Deleted volume successfully. Sep 28 12:16:12 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 Sep 28 12:16:12 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2dfc9436-e9ce-4454-89ab-ec1c0703ac57 tempest-VolumesGetTest-431672013 None] Lock "cinder-4e514383-66b0-48d1-a8bf-72ff992a3027-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:12 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70" returned: 0 in 0.500s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:12 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70 Sep 28 12:16:12 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:12 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-fbce0b42-3b9a-464b-b1c1-646984198d70" returned: 0 in 0.272s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-fbce0b42-3b9a-464b-b1c1-646984198d70" released by "delete_volume" :: held 0.881s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Created reservations ['409e454f-e6e1-49a7-a4df-de739e61410e', 'f9430aa8-847c-4f02-bc20-9553f9e866af', 'a36d01fd-9267-4687-a8a5-79fb19e58b14', '17501010-448d-4137-aeb5-51dd14e217a2'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:13 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:16:13 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:13 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.344s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:13 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Deleted volume successfully. Sep 28 12:16:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-229da2af-2875-4d2d-85d0-b956ca785f8b tempest-VolumesGetTest-431672013 None] Lock "cinder-fbce0b42-3b9a-464b-b1c1-646984198d70-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (db67603b-8500-40bf-8b3c-56760e4a4830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d90be32-5055-4acb-8013-204321add4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d90be32-5055-4acb-8013-204321add4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1867672689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:14Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2039cd0-6a11-4c23-937b-2bc7d0630a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2039cd0-6a11-4c23-937b-2bc7d0630a04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b71637-5260-4bee-a8de-f11a84becb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85b71637-5260-4bee-a8de-f11a84becb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c', 'volume_name': 'volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad516291-a24d-4fc4-a736-a0f1c662a6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad516291-a24d-4fc4-a736-a0f1c662a6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f802a5cd-7b65-4328-ba18-383a1d8f9dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:14 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Volume 7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:16:14 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Trying to clone 7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c from image d446342e-1c65-4f57-97fb-ae62bc9167ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:16:15 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:16:15 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:16:15 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f011174-7286-48eb-831b-3f604b41063e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:15 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD Sep 28 12:16:15 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:15 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:15 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef is fetched for user f23c7ee3ac2947cc91a4452de7267d87. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:16:15 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ba011a-eb89-452e-9af0-0b003d4ea7fe]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:15 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD Sep 28 12:16:15 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:16 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1867672689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:14Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Creating volume 7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:16 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:16 devstack sudo[93198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c 1073741824 Sep 28 12:16:16 devstack sudo[93198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:16 devstack sudo[93198]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c 1073741824" returned: 0 in 0.545s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:16 devstack sudo[93204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c Sep 28 12:16:16 devstack sudo[93204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:17 devstack sudo[93204]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c" returned: 0 in 0.275s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Attempting download of d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume 7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ceb7654-c54a-4e0d-8a46-9fd8d7575e3b]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_1u3d2hzd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:17 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_1u3d2hzd Sep 28 12:16:17 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:17 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_1u3d2hzd" returned: 0 in 0.374s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_1u3d2hzd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:17 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_1u3d2hzd Sep 28 12:16:17 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:17 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_1u3d2hzd" returned: 1 in 0.409s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_1u3d2hzd' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b35dd7-108f-4384-a610-f48e5a0648c7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:18 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD Sep 28 12:16:18 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:18 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:18 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] d446342e-1c65-4f57-97fb-ae62bc9167ef was qcow2, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:16:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:18 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c Sep 28 12:16:18 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:20 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c" returned: 0 in 2.301s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:20 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_982p68m4devstack@QuobyteHD, size 112.00 MB, duration 2.30 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:16:20 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Converted 112.00 MB image at 48.64 MB/s Sep 28 12:16:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:20 devstack sudo[93229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c 1G Sep 28 12:16:20 devstack sudo[93229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:21 devstack sudo[93229]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c 1G" returned: 0 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Downloaded image d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume 7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef for user f23c7ee3ac2947cc91a4452de7267d87 is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Marking volume 7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Copying metadata from image d446342e-1c65-4f57-97fb-ae62bc9167ef to 7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Creating volume glance metadata for volume 7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c backed by image d446342e-1c65-4f57-97fb-ae62bc9167ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f802a5cd-7b65-4328-ba18-383a1d8f9dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b173538-26f8-43d6-bc6c-c5763410bff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:21 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Volume volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c (7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c): created successfully Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b173538-26f8-43d6-bc6c-c5763410bff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (db67603b-8500-40bf-8b3c-56760e4a4830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:21 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-cfc91bd8-8830-4fd8-ba2f-cc91531eb6fc tempest-VolumesGetTest-431672013 None] Created volume successfully. Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (b1ad7453-c16f-40d9-b41a-7b7bc1a9eb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958fe6ba-d1e6-4eb0-98d2-b82100538525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (958fe6ba-d1e6-4eb0-98d2-b82100538525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-323547710',display_name='tempest-VolumesGetTest-Volume-2097800081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c021ae-a0af-4cc1-aced-98b1cc94f318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:23Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057cbf8b-b14e-4cbc-b1e7-c31347fee7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057cbf8b-b14e-4cbc-b1e7-c31347fee7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb56447-db96-4769-88d0-46026b7c425b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fb56447-db96-4769-88d0-46026b7c425b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c021ae-a0af-4cc1-aced-98b1cc94f318', 'volume_name': 'volume-74c021ae-a0af-4cc1-aced-98b1cc94f318', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf85bb2-b377-4fcb-8ed9-c694add390b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf85bb2-b377-4fcb-8ed9-c694add390b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b88dc81-c5cd-41da-9653-87da801d8a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:22 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Volume 74c021ae-a0af-4cc1-aced-98b1cc94f318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c021ae-a0af-4cc1-aced-98b1cc94f318', 'volume_size': 1} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:22Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-323547710',display_name='tempest-VolumesGetTest-Volume-2097800081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c021ae-a0af-4cc1-aced-98b1cc94f318,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa85255b0b3a48fd838d57d072967c54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:23Z,use_quota=True,user_id='f23c7ee3ac2947cc91a4452de7267d87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Creating volume 74c021ae-a0af-4cc1-aced-98b1cc94f318 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:22 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:16:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:22 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 1073741824 Sep 28 12:16:22 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:23 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 1073741824" returned: 0 in 0.689s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:23 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 Sep 28 12:16:23 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Flow 'volume_create_manager' (83d15dc1-0e3a-4fdd-a60f-488045038164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e812027-a7e5-4a01-a76b-ccc869f6a12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e812027-a7e5-4a01-a76b-ccc869f6a12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1379965378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e280083-62f0-45c7-a655-016e41698d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066c4996b78e4095a06927d4a860bcb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:24Z,use_quota=True,user_id='9b946d093da64cdfa5c7e151c0a2a9e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a5e3c47-7e39-4c15-8e59-b7915d5242ec),volume_type_id=5a5e3c47-7e39-4c15-8e59-b7915d5242ec)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210dd39f-8106-417e-9b94-ba2afb6c6c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (210dd39f-8106-417e-9b94-ba2afb6c6c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:23 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82dbc9a-e34f-41a0-b66e-bd32532fdeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82dbc9a-e34f-41a0-b66e-bd32532fdeb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e280083-62f0-45c7-a655-016e41698d3b', 'volume_name': 'volume-1e280083-62f0-45c7-a655-016e41698d3b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da80011-7f7d-479c-84f5-658ad3a618cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da80011-7f7d-479c-84f5-658ad3a618cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91722d2-b686-4c89-b4db-54255e82b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:23 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Volume 1e280083-62f0-45c7-a655-016e41698d3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e280083-62f0-45c7-a655-016e41698d3b', 'volume_size': 1} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318" returned: 0 in 0.458s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1379965378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e280083-62f0-45c7-a655-016e41698d3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='066c4996b78e4095a06927d4a860bcb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:24Z,use_quota=True,user_id='9b946d093da64cdfa5c7e151c0a2a9e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5a5e3c47-7e39-4c15-8e59-b7915d5242ec),volume_type_id=5a5e3c47-7e39-4c15-8e59-b7915d5242ec)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Creating volume 1e280083-62f0-45c7-a655-016e41698d3b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:23 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:16:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b88dc81-c5cd-41da-9653-87da801d8a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c021ae-a0af-4cc1-aced-98b1cc94f318', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:24 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b 1073741824 Sep 28 12:16:24 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deeec369-0f7c-4ddb-b411-4ccd6422fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:24 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Volume volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 (74c021ae-a0af-4cc1-aced-98b1cc94f318): created successfully Sep 28 12:16:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deeec369-0f7c-4ddb-b411-4ccd6422fa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Flow 'volume_create_manager' (b1ad7453-c16f-40d9-b41a-7b7bc1a9eb5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:24 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3e77a4fe-d85d-4eda-8128-51f7a2933e0f tempest-VolumesGetTest-431672013 None] Created volume successfully. Sep 28 12:16:24 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b 1073741824" returned: 0 in 0.766s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:24 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b Sep 28 12:16:24 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-74c021ae-a0af-4cc1-aced-98b1cc94f318-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Lock "cinder-74c021ae-a0af-4cc1-aced-98b1cc94f318-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:25 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-quobyte-74c021ae-a0af-4cc1-aced-98b1cc94f318" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b" returned: 0 in 0.344s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] <== create_volume: return (1178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-74c021ae-a0af-4cc1-aced-98b1cc94f318" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91722d2-b686-4c89-b4db-54255e82b21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e280083-62f0-45c7-a655-016e41698d3b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17859ca8-b978-4bfc-9535-d4627d0e6b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[324bf4a2-abf3-47df-bc37-5a8afde8f145]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:25 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Volume volume-1e280083-62f0-45c7-a655-016e41698d3b (1e280083-62f0-45c7-a655-016e41698d3b): created successfully Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17859ca8-b978-4bfc-9535-d4627d0e6b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Flow 'volume_create_manager' (83d15dc1-0e3a-4fdd-a60f-488045038164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:25 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2d047c74-bc99-4b96-88b6-7ff542b427c2 tempest-VolumeTypesAccessTest-597640290 None] Created volume successfully. Sep 28 12:16:25 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 Sep 28 12:16:25 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:25 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318" returned: 0 in 0.516s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:25 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318 Sep 28 12:16:25 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Acquiring lock "cinder-1e280083-62f0-45c7-a655-016e41698d3b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Lock "cinder-1e280083-62f0-45c7-a655-016e41698d3b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Acquiring lock "cinder-quobyte-1e280083-62f0-45c7-a655-016e41698d3b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Lock "cinder-quobyte-1e280083-62f0-45c7-a655-016e41698d3b" acquired by "delete_volume" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccfc4c1-8f12-46d7-8114-1fa0ac6bab17]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:26 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-74c021ae-a0af-4cc1-aced-98b1cc94f318" returned: 0 in 0.381s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-74c021ae-a0af-4cc1-aced-98b1cc94f318" released by "delete_volume" :: held 0.983s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:26 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Created reservations ['5946ca06-99b3-452c-9876-363bf21eedeb', '87e4f39a-a8ec-46ed-9dd0-80bac12693db', 'ec41f578-fd54-4e49-b010-aecde9797046', 'f4365436-19ff-4b00-b6eb-bd061a7766c7'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:26 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:26 devstack sudo[93291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:16:26 devstack sudo[93291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:26 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b" returned: 0 in 0.608s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:26 devstack sudo[93298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b Sep 28 12:16:26 devstack sudo[93298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:26 devstack sudo[93291]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.381s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:26 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Deleted volume successfully. Sep 28 12:16:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-711000b0-0aa4-4dfe-b102-b97d0aee9896 tempest-VolumesGetTest-431672013 None] Lock "cinder-74c021ae-a0af-4cc1-aced-98b1cc94f318-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:27 devstack sudo[93298]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e280083-62f0-45c7-a655-016e41698d3b" returned: 0 in 0.365s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Lock "cinder-quobyte-1e280083-62f0-45c7-a655-016e41698d3b" released by "delete_volume" :: held 1.052s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:27 devstack cinder-volume[87048]: WARNING cinder.quota [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1146852971 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1146852971, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:16:27 devstack cinder-volume[87048]: WARNING cinder.quota [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1146852971 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1146852971, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Created reservations ['e1ca6a98-d433-4731-ae00-eed391c2ca12', '732ba508-5028-4239-81c9-9d7581f96abc', 'c6c1076c-415c-42cf-81a7-62e540db0517', '4b677b70-c59b-413a-b4fb-55e0df12c0c2'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:27 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:16:27 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Lock "cinder-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Acquiring lock "cinder-quobyte-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:27 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c" acquired by "delete_volume" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.404s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:27 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Deleted volume successfully. Sep 28 12:16:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc246a1-30e3-47cb-b4ed-0b6023719462]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5bef4c8a-60e9-4292-b7a2-5c7c569d890c tempest-VolumeTypesAccessTest-597640290 None] Lock "cinder-1e280083-62f0-45c7-a655-016e41698d3b-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:28 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c Sep 28 12:16:28 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:28 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c" returned: 0 in 0.708s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:28 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c Sep 28 12:16:28 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:29 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c" returned: 0 in 0.390s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Lock "cinder-quobyte-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c" released by "delete_volume" :: held 1.220s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Created reservations ['4960a1c4-525b-43fc-88df-656859cb7297', '7dadac4a-560c-449a-b70d-5f83acb070d2', '1c882d7e-9852-4e65-b3a3-8f3a9b465d6b', 'ac720b71-c225-421d-9ee7-c5bb94f5cca9'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:29 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:16:29 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:29 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Deleted volume successfully. Sep 28 12:16:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6bb4f480-564d-4503-a1b6-5d768c72a85e tempest-VolumesGetTest-431672013 None] Lock "cinder-7ce8b158-c5c0-4cfa-8ebc-0ac1989c7d4c-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Flow 'volume_create_manager' (198b524b-8cad-44b6-8ae8-42adc5f3c659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231197ac-c904-425f-85e1-e1cc782556cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (231197ac-c904-425f-85e1-e1cc782556cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1084230930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca811ef-852b-4ba5-8c71-913f62b6e7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2b91f8bebb470fbb1519eb8a354ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:36Z,use_quota=True,user_id='d99163cfa3f7408d8d7c613eb09a7828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4aa9ae0-5d12-4ea4-a326-7d7fdde14229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4aa9ae0-5d12-4ea4-a326-7d7fdde14229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59295a6d-2f04-4f41-8a80-794c8945a90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59295a6d-2f04-4f41-8a80-794c8945a90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca811ef-852b-4ba5-8c71-913f62b6e7b0', 'volume_name': 'volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9c2bfd-f82f-402b-9bec-14afa64444a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9c2bfd-f82f-402b-9bec-14afa64444a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f4e8fd-0210-4f62-8a72-f09f9902fa47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:36 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Volume 7ca811ef-852b-4ba5-8c71-913f62b6e7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0', 'volume_size': 1} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1084230930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca811ef-852b-4ba5-8c71-913f62b6e7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d2b91f8bebb470fbb1519eb8a354ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:16:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:16:36Z,use_quota=True,user_id='d99163cfa3f7408d8d7c613eb09a7828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Creating volume 7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:16:36 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:16:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:36 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 1073741824 Sep 28 12:16:36 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:37 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 1073741824" returned: 0 in 1.120s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:37 devstack sudo[93367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 Sep 28 12:16:37 devstack sudo[93367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:38 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:16:38 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:38 devstack sudo[93367]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" returned: 0 in 0.568s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:38 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f4e8fd-0210-4f62-8a72-f09f9902fa47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4059ca7e-b1a0-4a7e-b009-91e61ecba59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.445s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:16:38 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Volume volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 (7ca811ef-852b-4ba5-8c71-913f62b6e7b0): created successfully Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4059ca7e-b1a0-4a7e-b009-91e61ecba59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:16:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Flow 'volume_create_manager' (198b524b-8cad-44b6-8ae8-42adc5f3c659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:16:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a52dedd4-c7ec-4dd7-beed-da38ccb59fdc tempest-VolumesSnapshotListTestJSON-759494112 None] Created volume successfully. Sep 28 12:16:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Creating offline snapshot a90ecd2e-0c0c-48e3-8995-017efad273fd of volume 7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:16:39 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00cbd59-cc12-4ee6-8911-3d45c161514e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:39 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 Sep 28 12:16:39 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:39 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" returned: 0 in 0.543s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:39 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd 1G Sep 28 12:16:39 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:40 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd 1G" returned: 0 in 0.560s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:40 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd Sep 28 12:16:40 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:40 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd" returned: 0 in 0.343s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:40 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd is being set with open permissions: ugo+rw Sep 28 12:16:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:40 devstack sudo[93413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd Sep 28 12:16:40 devstack sudo[93413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:40 devstack sudo[93413]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd" returned: 0 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:41 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.info Sep 28 12:16:41 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:41 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.info" returned: 0 in 0.307s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:41 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.info is being set with open permissions: ugo+rw Sep 28 12:16:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:41 devstack sudo[93421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.info Sep 28 12:16:41 devstack sudo[93421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:41 devstack sudo[93421]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.info" returned: 0 in 0.301s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:41 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-57291543-81a1-4624-9760-f642c9d0d6e5 tempest-VolumesSnapshotListTestJSON-759494112 None] Create snapshot completed successfully Sep 28 12:16:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Creating offline snapshot 5ded319c-7d8d-49b4-af5d-c7d962232b59 of volume 7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:16:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d7f682-5064-4dc8-a21c-913d89537910]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:42 devstack sudo[93426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd Sep 28 12:16:42 devstack sudo[93426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:43 devstack sudo[93426]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd" returned: 0 in 0.451s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:16:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:43 devstack sudo[93431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 1G Sep 28 12:16:43 devstack sudo[93431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:43 devstack sudo[93431]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 1G" returned: 0 in 0.587s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:43 devstack sudo[93437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 Sep 28 12:16:43 devstack sudo[93437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:44 devstack sudo[93437]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:44 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 is being set with open permissions: ugo+rw Sep 28 12:16:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:44 devstack sudo[93442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 Sep 28 12:16:44 devstack sudo[93442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:44 devstack sudo[93442]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59" returned: 0 in 0.286s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.830s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0e2e577c-b787-46ae-ac9c-ea8fe7df6f37 tempest-VolumesSnapshotListTestJSON-759494112 None] Create snapshot completed successfully Sep 28 12:16:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:16:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:16:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Creating offline snapshot d202b3ca-1f6d-4ada-b269-b830b31b6970 of volume 7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:16:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bafe07-c56d-46a1-aed1-fbbf8a6654e5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:45 devstack sudo[93446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 Sep 28 12:16:45 devstack sudo[93446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:45 devstack sudo[93446]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59" returned: 0 in 0.497s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:16:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:45 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 1G Sep 28 12:16:45 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:46 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 1G" returned: 0 in 0.718s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:46 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 Sep 28 12:16:46 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:46 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970" returned: 0 in 0.808s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:46 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 is being set with open permissions: ugo+rw Sep 28 12:16:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:46 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 Sep 28 12:16:46 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:47 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970" returned: 0 in 0.549s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.732s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:16:47 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-98106c19-10a8-4929-90cd-4a1b7016a0d4 tempest-VolumesSnapshotListTestJSON-759494112 None] Create snapshot completed successfully Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-d202b3ca-1f6d-4ada-b269-b830b31b6970-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-d202b3ca-1f6d-4ada-b269-b830b31b6970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-quobyte-d202b3ca-1f6d-4ada-b269-b830b31b6970" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-d202b3ca-1f6d-4ada-b269-b830b31b6970" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Deleting offline snapshot d202b3ca-1f6d-4ada-b269-b830b31b6970 of volume 7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] snapshot_file for this snap is: volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[852c61f1-9b32-4db8-9570-adfdeaf103ca]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:50 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 Sep 28 12:16:50 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:51 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970" returned: 0 in 0.799s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:16:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3c0b36-4930-4e5b-857d-9fbdeba17b3b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:51 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 Sep 28 12:16:51 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:52 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59" returned: 0 in 0.846s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:16:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:52 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 Sep 28 12:16:52 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:53 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970" returned: 0 in 1.531s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:53 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970 Sep 28 12:16:53 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:54 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.d202b3ca-1f6d-4ada-b269-b830b31b6970" returned: 0 in 0.463s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-d202b3ca-1f6d-4ada-b269-b830b31b6970" released by "_delete_snapshot" :: held 3.906s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" released by "delete_snapshot" :: held 3.959s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:54 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Created reservations ['a71fc415-2325-4ee8-b850-966c3262854a', '21f1e877-4575-4d5d-9090-5bce84a1a544', '60e40b01-5dcb-4fd5-bfa8-a41dbda60567', '87051185-fb5d-47fe-9bcc-6d889ba39d7e'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:54 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Delete snapshot completed successfully. Sep 28 12:16:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7f0b8677-19b0-4114-af15-ee294f3d6be2 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-d202b3ca-1f6d-4ada-b269-b830b31b6970-delete_snapshot" released by "delete_snapshot" :: held 4.300s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-5ded319c-7d8d-49b4-af5d-c7d962232b59-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-5ded319c-7d8d-49b4-af5d-c7d962232b59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-quobyte-5ded319c-7d8d-49b4-af5d-c7d962232b59" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:16:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-5ded319c-7d8d-49b4-af5d-c7d962232b59" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:16:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Deleting offline snapshot 5ded319c-7d8d-49b4-af5d-c7d962232b59 of volume 7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:16:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] snapshot_file for this snap is: volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:16:55 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a7e854-b158-4fb5-9a49-11386eec657b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:55 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 Sep 28 12:16:55 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:56 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59" returned: 0 in 1.261s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:16:56 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[814746b1-b6aa-46c8-8286-8e14490c2a7b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:16:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:56 devstack sudo[93744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd Sep 28 12:16:56 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:57 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd" returned: 0 in 0.974s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:16:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:57 devstack sudo[93749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 Sep 28 12:16:57 devstack sudo[93749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:58 devstack sudo[93749]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59" returned: 0 in 1.254s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:16:58 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59 Sep 28 12:16:58 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:16:59 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Sep 28 12:16:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.5ded319c-7d8d-49b4-af5d-c7d962232b59" returned: 0 in 0.330s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:16:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-5ded319c-7d8d-49b4-af5d-c7d962232b59" released by "_delete_snapshot" :: held 4.080s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" released by "delete_snapshot" :: held 4.144s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:16:59 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Created reservations ['5247a895-e017-43fe-8dd0-b536b3604ec4', 'c34d04d8-fdfc-4096-9abc-495e4e10d9cd', '5a7feb28-d0db-4df3-8a78-daee772eebc5', '247c2c01-8f2c-417e-a85a-933390e3e667'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:16:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Delete snapshot completed successfully. Sep 28 12:16:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-760b6da6-9a66-40be-be10-b4ac5a78e88b tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-5ded319c-7d8d-49b4-af5d-c7d962232b59-delete_snapshot" released by "delete_snapshot" :: held 4.576s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-a90ecd2e-0c0c-48e3-8995-017efad273fd-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-a90ecd2e-0c0c-48e3-8995-017efad273fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-quobyte-a90ecd2e-0c0c-48e3-8995-017efad273fd" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-a90ecd2e-0c0c-48e3-8995-017efad273fd" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Deleting offline snapshot a90ecd2e-0c0c-48e3-8995-017efad273fd of volume 7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] snapshot_file for this snap is: volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c6b736-2122-49e5-bef1-d7a9364fc934]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:01 devstack sudo[93761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd Sep 28 12:17:01 devstack sudo[93761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:01 devstack sudo[93761]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd" returned: 0 in 1.082s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:17:01 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e0635-d8ac-4f86-bf3d-a829cb45c5a5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:02 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 Sep 28 12:17:02 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:03 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" returned: 0 in 1.348s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:03 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd Sep 28 12:17:03 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:04 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd" returned: 0 in 1.110s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:04 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd Sep 28 12:17:04 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:05 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0.a90ecd2e-0c0c-48e3-8995-017efad273fd" returned: 0 in 0.969s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:05 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=78,cinder:UPDATE=106,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:17:05 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=79,cinder:INSERT=32,cinder:UPDATE=92,cinder:DELETE=8 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:17:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-a90ecd2e-0c0c-48e3-8995-017efad273fd" released by "_delete_snapshot" :: held 4.834s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" released by "delete_snapshot" :: held 4.937s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:05 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Created reservations ['48a88c26-b388-4cf9-a7b3-20529949b735', '78b9fc8f-1db5-4c76-aabe-97d233fc0a1f', 'fd31a179-8793-45e5-be5b-7e8097fb6cef', '212b449e-c13a-45fb-af28-795805b0de01'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Delete snapshot completed successfully. Sep 28 12:17:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-648a65f3-8152-45e2-8922-22de92a0d4a8 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-a90ecd2e-0c0c-48e3-8995-017efad273fd-delete_snapshot" released by "delete_snapshot" :: held 5.402s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-7ca811ef-852b-4ba5-8c71-913f62b6e7b0-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-7ca811ef-852b-4ba5-8c71-913f62b6e7b0-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" acquired by "delete_volume" :: waited 0.046s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:07 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcec4643-1946-4c2c-993b-d1a51e431e77]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:07 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 Sep 28 12:17:07 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:08 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" returned: 0 in 0.871s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:08 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0 Sep 28 12:17:08 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:09 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" returned: 0 in 0.727s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-quobyte-7ca811ef-852b-4ba5-8c71-913f62b6e7b0" released by "delete_volume" :: held 1.827s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:09 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Created reservations ['334b52bf-f204-4ef6-9bca-2dd94293e002', '0038f303-4cb8-4686-91e7-84462595981c', '0d98a4bb-7056-4fa5-ae43-672497963ebc', '34f91ca5-779d-4ab9-9c91-92b58be9dab0'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:09 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:17:09 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:10 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.532s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:10 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:10 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Deleted volume successfully. Sep 28 12:17:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-60277d91-5542-41c2-a482-7367067200f7 tempest-VolumesSnapshotListTestJSON-759494112 None] Lock "cinder-7ca811ef-852b-4ba5-8c71-913f62b6e7b0-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:13 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Flow 'volume_create_manager' (33482118-a243-43f4-9866-8246a1c16f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6de003d-4e22-4647-81eb-aaeac49fc96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6de003d-4e22-4647-81eb-aaeac49fc96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2587633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090a6ee2-d98c-4768-9f3c-73a9b39f86f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28b35a741f57451dbc5b71007f2d71ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:14Z,use_quota=True,user_id='b3782405c5244441a2e5629b5bcab820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5d978b-986f-498c-842e-9331b3f8dfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5d978b-986f-498c-842e-9331b3f8dfc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e931a827-d040-4087-aa50-0adcc7ab8db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e931a827-d040-4087-aa50-0adcc7ab8db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090a6ee2-d98c-4768-9f3c-73a9b39f86f5', 'volume_name': 'volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3306e9-2da6-439e-844a-78b8381e4003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3306e9-2da6-439e-844a-78b8381e4003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9593312-aaff-45fe-ae46-90957fb7f819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:14 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Volume 090a6ee2-d98c-4768-9f3c-73a9b39f86f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5', 'volume_size': 1} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2587633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090a6ee2-d98c-4768-9f3c-73a9b39f86f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28b35a741f57451dbc5b71007f2d71ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:14Z,use_quota=True,user_id='b3782405c5244441a2e5629b5bcab820',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Creating volume 090a6ee2-d98c-4768-9f3c-73a9b39f86f5 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:14 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:14 devstack sudo[93942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 1073741824 Sep 28 12:17:14 devstack sudo[93942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:14 devstack sudo[93942]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 1073741824" returned: 0 in 0.650s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:14 devstack sudo[93948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 Sep 28 12:17:14 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:15 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5" returned: 0 in 0.419s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9593312-aaff-45fe-ae46-90957fb7f819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a05c370-7938-4a77-9172-167c0bd6b203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:15 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Volume volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 (090a6ee2-d98c-4768-9f3c-73a9b39f86f5): created successfully Sep 28 12:17:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a05c370-7938-4a77-9172-167c0bd6b203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Flow 'volume_create_manager' (33482118-a243-43f4-9866-8246a1c16f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1a8eebc8-43f4-4973-9b9c-7ceb7eca48f0 tempest-ServerRescueNegativeTestJSON-44144657 None] Created volume successfully. Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Flow 'volume_create_manager' (87733317-71a0-4b51-b305-05989a4e845f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac95d663-c37d-4a8d-b7f1-03806ecf08ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac95d663-c37d-4a8d-b7f1-03806ecf08ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-98781479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90778f1d-30b1-40f2-abfb-56c136016e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e37065983c47f8b07815b6d49e3403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:16Z,use_quota=True,user_id='3bdedac3c6734a96ae12cbc10d95c45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0066571a-61f3-428a-a3f1-0c3b4113ae4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0066571a-61f3-428a-a3f1-0c3b4113ae4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9648d5f7-a889-4232-bc85-fb852e191607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9648d5f7-a889-4232-bc85-fb852e191607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90778f1d-30b1-40f2-abfb-56c136016e11', 'volume_name': 'volume-90778f1d-30b1-40f2-abfb-56c136016e11', 'volume_size': 2}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1930f4d-2c65-4e89-91ab-85183b11479b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1930f4d-2c65-4e89-91ab-85183b11479b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d721b59-d486-4377-ad15-4efa701087b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:16 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Volume 90778f1d-30b1-40f2-abfb-56c136016e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90778f1d-30b1-40f2-abfb-56c136016e11', 'volume_size': 2} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-98781479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90778f1d-30b1-40f2-abfb-56c136016e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e37065983c47f8b07815b6d49e3403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:16Z,use_quota=True,user_id='3bdedac3c6734a96ae12cbc10d95c45e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Creating volume 90778f1d-30b1-40f2-abfb-56c136016e11 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:16 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:17:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 2147483648 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:16 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 2147483648 Sep 28 12:17:16 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:17 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 2147483648" returned: 0 in 0.738s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:17 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 Sep 28 12:17:17 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:17 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11" returned: 0 in 0.398s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d721b59-d486-4377-ad15-4efa701087b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90778f1d-30b1-40f2-abfb-56c136016e11', 'volume_size': 2}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d1dc1-91aa-43d7-95b9-5aec940c7df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:17 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Volume volume-90778f1d-30b1-40f2-abfb-56c136016e11 (90778f1d-30b1-40f2-abfb-56c136016e11): created successfully Sep 28 12:17:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289d1dc1-91aa-43d7-95b9-5aec940c7df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Flow 'volume_create_manager' (87733317-71a0-4b51-b305-05989a4e845f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b84dcb9f-37f0-47e5-8e29-46b5d20cb3db tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Created volume successfully. Sep 28 12:17:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Creating offline snapshot 0d4310a0-2a20-4d5d-b409-8f96e559391f of volume 90778f1d-30b1-40f2-abfb-56c136016e11 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:17:19 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d938e9bc-56c5-4472-b559-fa8f968d65e8]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:19 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 Sep 28 12:17:19 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:19 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11" returned: 0 in 0.748s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f 2G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:20 devstack sudo[93968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f 2G Sep 28 12:17:20 devstack sudo[93968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:20 devstack sudo[93968]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f 2G" returned: 0 in 0.990s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90778f1d-30b1-40f2-abfb-56c136016e11 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:21 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90778f1d-30b1-40f2-abfb-56c136016e11 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f Sep 28 12:17:21 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:21 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90778f1d-30b1-40f2-abfb-56c136016e11 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f" returned: 0 in 0.593s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:21 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f is being set with open permissions: ugo+rw Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:21 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f Sep 28 12:17:21 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Flow 'volume_create_manager' (06caa3d1-d004-4b38-a6cf-c98baaca0830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f217149-b110-481f-abde-5bee09c7165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f217149-b110-481f-abde-5bee09c7165d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-40560916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea901e7-2363-49bb-98a2-aa24f964ed44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fce04b5e9d40f28187592a1f7f307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:22Z,use_quota=True,user_id='a4027e9c29ba4894888c11adc5f6f6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbccd29d-118c-451d-95a0-eae24e0c3a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbccd29d-118c-451d-95a0-eae24e0c3a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d5ad6c-5ba6-493a-8cff-50db60d62a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d5ad6c-5ba6-493a-8cff-50db60d62a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea901e7-2363-49bb-98a2-aa24f964ed44', 'volume_name': 'volume-aea901e7-2363-49bb-98a2-aa24f964ed44', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2d2bab-c563-47b6-a6f6-97cdef45f51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb2d2bab-c563-47b6-a6f6-97cdef45f51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27809972-552e-4689-a9ea-cb2e282c7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:21 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Volume aea901e7-2363-49bb-98a2-aa24f964ed44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea901e7-2363-49bb-98a2-aa24f964ed44', 'volume_size': 1} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:21 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f" returned: 0 in 0.373s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:22 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.info Sep 28 12:17:22 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:22 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.info" returned: 0 in 0.376s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:22 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.info is being set with open permissions: ugo+rw Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:22 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.info Sep 28 12:17:22 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:22 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.info" returned: 0 in 0.435s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.669s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-40560916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea901e7-2363-49bb-98a2-aa24f964ed44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fce04b5e9d40f28187592a1f7f307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:22Z,use_quota=True,user_id='a4027e9c29ba4894888c11adc5f6f6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Creating volume aea901e7-2363-49bb-98a2-aa24f964ed44 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:22 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:17:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:22 devstack sudo[94032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44 1073741824 Sep 28 12:17:22 devstack sudo[94032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3c407884-d819-497e-93a0-ba881041ff2c tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Create snapshot completed successfully Sep 28 12:17:23 devstack sudo[94032]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44 1073741824" returned: 0 in 0.674s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Acquiring lock "cinder-0d4310a0-2a20-4d5d-b409-8f96e559391f-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-0d4310a0-2a20-4d5d-b409-8f96e559391f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.098s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Acquiring lock "cinder-quobyte-90778f1d-30b1-40f2-abfb-56c136016e11" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-quobyte-90778f1d-30b1-40f2-abfb-56c136016e11" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Acquiring lock "cinder-quobyte-0d4310a0-2a20-4d5d-b409-8f96e559391f" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-quobyte-0d4310a0-2a20-4d5d-b409-8f96e559391f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Deleting offline snapshot 0d4310a0-2a20-4d5d-b409-8f96e559391f of volume 90778f1d-30b1-40f2-abfb-56c136016e11 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:17:23 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44 Sep 28 12:17:23 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] snapshot_file for this snap is: volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb4e0b7-2c6f-47e7-b083-bf4f0376752e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:24 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f Sep 28 12:17:24 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:24 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44" returned: 0 in 0.720s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27809972-552e-4689-a9ea-cb2e282c7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea901e7-2363-49bb-98a2-aa24f964ed44', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e28c05c-dd71-42fb-85b8-29a4c489a32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:24 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Volume volume-aea901e7-2363-49bb-98a2-aa24f964ed44 (aea901e7-2363-49bb-98a2-aa24f964ed44): created successfully Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e28c05c-dd71-42fb-85b8-29a4c489a32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Flow 'volume_create_manager' (06caa3d1-d004-4b38-a6cf-c98baaca0830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:24 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-76ead49d-9d93-4462-a7ee-a0c414c789b9 tempest-AttachVolumeTestJSON-1586863211 None] Created volume successfully. Sep 28 12:17:24 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f" returned: 0 in 0.802s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90778f1d-30b1-40f2-abfb-56c136016e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e7cd37-6b99-49e4-8e23-5fa6425d9f4c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:24 devstack sudo[94064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 Sep 28 12:17:24 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:25 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11" returned: 0 in 0.744s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:25 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f Sep 28 12:17:25 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:26 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f" returned: 0 in 0.888s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:26 devstack sudo[94112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f Sep 28 12:17:26 devstack sudo[94112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-56ef1313-db7a-4393-bf7a-c9038020e843 req-77f291ee-9223-44e1-937a-cce169abb8e2 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-56ef1313-db7a-4393-bf7a-c9038020e843 req-77f291ee-9223-44e1-937a-cce169abb8e2 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-56ef1313-db7a-4393-bf7a-c9038020e843 req-77f291ee-9223-44e1-937a-cce169abb8e2 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:26 devstack sudo[94112]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-56ef1313-db7a-4393-bf7a-c9038020e843 req-77f291ee-9223-44e1-937a-cce169abb8e2 tempest-AttachVolumeTestJSON-1586863211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-aea901e7-2363-49bb-98a2-aa24f964ed44', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d324ce8-187e-49d9-b522-73110ec7a844', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:17:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11.0d4310a0-2a20-4d5d-b409-8f96e559391f" returned: 0 in 0.539s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-quobyte-0d4310a0-2a20-4d5d-b409-8f96e559391f" released by "_delete_snapshot" :: held 3.273s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-quobyte-90778f1d-30b1-40f2-abfb-56c136016e11" released by "delete_snapshot" :: held 3.311s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-56ef1313-db7a-4393-bf7a-c9038020e843 req-77f291ee-9223-44e1-937a-cce169abb8e2 tempest-AttachVolumeTestJSON-1586863211 None] attachment_update completed successfully. Sep 28 12:17:27 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Created reservations ['fe51950a-2338-4c02-a24d-28c62bca2b54', '8452bbf3-70bf-497a-9923-4f0bde9080e9', '571c3f12-713b-4483-8ce3-47ea05f20529', '821bd20b-892f-4fef-9df0-1b211246f954'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Delete snapshot completed successfully. Sep 28 12:17:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-485a2a99-c996-4ce9-99bc-28b21e2c14cf tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-0d4310a0-2a20-4d5d-b409-8f96e559391f-delete_snapshot" released by "delete_snapshot" :: held 3.702s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Acquiring lock "cinder-90778f1d-30b1-40f2-abfb-56c136016e11-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-90778f1d-30b1-40f2-abfb-56c136016e11-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Acquiring lock "cinder-quobyte-90778f1d-30b1-40f2-abfb-56c136016e11" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-quobyte-90778f1d-30b1-40f2-abfb-56c136016e11" acquired by "delete_volume" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c756480-e86a-45f9-8cc3-8e8025874731]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:28 devstack sudo[94549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 Sep 28 12:17:28 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:29 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11" returned: 0 in 0.567s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:29 devstack sudo[94567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11 Sep 28 12:17:29 devstack sudo[94567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:29 devstack sudo[94567]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-90778f1d-30b1-40f2-abfb-56c136016e11" returned: 0 in 0.351s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-quobyte-90778f1d-30b1-40f2-abfb-56c136016e11" released by "delete_volume" :: held 1.014s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Created reservations ['04da1df4-e184-440c-9587-1cb06c68720a', '98cd0727-d9ef-442b-ad67-ec1d5c5cc6aa', '9bd7c9c4-a070-4c5e-97db-716740dd4e8e', '01ee5703-32aa-42a5-82cd-5f2dfc3b3e3f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:29 devstack sudo[94581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:17:29 devstack sudo[94581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:30 devstack sudo[94581]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.464s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:30 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:30 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Deleted volume successfully. Sep 28 12:17:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-28ac90a1-cba9-470b-87e2-79a3a4a546b9 tempest-VolumesSnapshotNegativeTestJSON-2050782225 None] Lock "cinder-90778f1d-30b1-40f2-abfb-56c136016e11-delete_volume" released by "delete_volume" :: held 1.859s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Flow 'volume_create_manager' (00205622-1a88-43f1-b6f9-9c016b795c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d5dd31-8f19-40ea-921e-ef907afbde13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d5dd31-8f19-40ea-921e-ef907afbde13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-558351889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bab8520-0298-41e6-9b73-b2554c68d759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fce04b5e9d40f28187592a1f7f307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:31Z,use_quota=True,user_id='a4027e9c29ba4894888c11adc5f6f6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50067adc-dedc-44fb-b46f-09573a51e60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50067adc-dedc-44fb-b46f-09573a51e60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7814f3-170f-475f-8e95-65dc7a629cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7814f3-170f-475f-8e95-65dc7a629cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bab8520-0298-41e6-9b73-b2554c68d759', 'volume_name': 'volume-3bab8520-0298-41e6-9b73-b2554c68d759', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cedcd5-c531-45ee-afa1-0cba26f6f29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15cedcd5-c531-45ee-afa1-0cba26f6f29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed9c930-f64b-47c6-a689-46eaa876700c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:31 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Volume 3bab8520-0298-41e6-9b73-b2554c68d759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bab8520-0298-41e6-9b73-b2554c68d759', 'volume_size': 1} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-558351889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bab8520-0298-41e6-9b73-b2554c68d759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81fce04b5e9d40f28187592a1f7f307d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:31Z,use_quota=True,user_id='a4027e9c29ba4894888c11adc5f6f6e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Creating volume 3bab8520-0298-41e6-9b73-b2554c68d759 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:31 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:17:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:31 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759 1073741824 Sep 28 12:17:31 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:32 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759 1073741824" returned: 0 in 1.379s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:32 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759 Sep 28 12:17:32 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:33 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759" returned: 0 in 0.390s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed9c930-f64b-47c6-a689-46eaa876700c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bab8520-0298-41e6-9b73-b2554c68d759', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ee8575-3576-41f0-aab5-ad6a974ce8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:33 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Volume volume-3bab8520-0298-41e6-9b73-b2554c68d759 (3bab8520-0298-41e6-9b73-b2554c68d759): created successfully Sep 28 12:17:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ee8575-3576-41f0-aab5-ad6a974ce8f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Flow 'volume_create_manager' (00205622-1a88-43f1-b6f9-9c016b795c11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-845c5af9-5f2e-44f7-8418-8080fd8031bf tempest-AttachVolumeTestJSON-1586863211 None] Created volume successfully. Sep 28 12:17:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Acquiring lock "cinder-090a6ee2-d98c-4768-9f3c-73a9b39f86f5-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "cinder-090a6ee2-d98c-4768-9f3c-73a9b39f86f5-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Acquiring lock "cinder-quobyte-090a6ee2-d98c-4768-9f3c-73a9b39f86f5" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "cinder-quobyte-090a6ee2-d98c-4768-9f3c-73a9b39f86f5" acquired by "delete_volume" :: waited 0.034s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:35 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[043cf3f9-adce-42b6-af62-6c6cf9522348]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:35 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 Sep 28 12:17:35 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:36 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5" returned: 0 in 0.792s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:36 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5 Sep 28 12:17:36 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:37 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-d260b141-8129-4db8-94af-858d321c8db0 req-fd97d748-c64e-49b2-9162-e0c339060522 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-d260b141-8129-4db8-94af-858d321c8db0 req-fd97d748-c64e-49b2-9162-e0c339060522 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-090a6ee2-d98c-4768-9f3c-73a9b39f86f5" returned: 0 in 0.800s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "cinder-quobyte-090a6ee2-d98c-4768-9f3c-73a9b39f86f5" released by "delete_volume" :: held 1.709s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-d260b141-8129-4db8-94af-858d321c8db0 req-fd97d748-c64e-49b2-9162-e0c339060522 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-d260b141-8129-4db8-94af-858d321c8db0 req-fd97d748-c64e-49b2-9162-e0c339060522 tempest-AttachVolumeTestJSON-1586863211 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-3bab8520-0298-41e6-9b73-b2554c68d759', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '24ffec03-3174-4d21-b396-78e52fe3e840', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Created reservations ['a5bc45f7-45c7-4082-aa3f-b5f869ee8a68', '9255ce25-6bb3-4d40-a732-4790cf46d8fc', '136ef8de-515c-46a5-984f-8c2282bc552f', '62b2e4d0-4a1e-4b47-b08d-7e26cced1127'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:37 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-d260b141-8129-4db8-94af-858d321c8db0 req-fd97d748-c64e-49b2-9162-e0c339060522 tempest-AttachVolumeTestJSON-1586863211 None] attachment_update completed successfully. Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:37 devstack sudo[94721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:17:37 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:38 devstack sudo[94727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:17:38 devstack sudo[94727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:38 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.663s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Deleted volume successfully. Sep 28 12:17:38 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c5677a56-9ed1-45cf-9cb3-ad33d6a33720 tempest-ServerRescueNegativeTestJSON-44144657 None] Lock "cinder-090a6ee2-d98c-4768-9f3c-73a9b39f86f5-delete_volume" released by "delete_volume" :: held 3.056s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (dba015e3-df70-4119-b228-6b5f8766d822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbba2ec-9452-49fa-b6ee-4286b8b63777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:39 devstack sudo[94727]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 1.312s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecbba2ec-9452-49fa-b6ee-4286b8b63777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1230282936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db12c4ca-671b-4e31-8ce9-d748ed484aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:39Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaca7d28-6f69-4fec-8e0b-b93ca8ba6463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaca7d28-6f69-4fec-8e0b-b93ca8ba6463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2364ff4-888f-4681-ac33-ee30b8dd5c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2364ff4-888f-4681-ac33-ee30b8dd5c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db12c4ca-671b-4e31-8ce9-d748ed484aac', 'volume_name': 'volume-db12c4ca-671b-4e31-8ce9-d748ed484aac', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef89c44-4899-47c0-aa06-8d95cd1d285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef89c44-4899-47c0-aa06-8d95cd1d285c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e6ecba-ebec-47c5-8399-9e61e61bcc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:39 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Volume db12c4ca-671b-4e31-8ce9-d748ed484aac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db12c4ca-671b-4e31-8ce9-d748ed484aac', 'volume_size': 1} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1230282936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db12c4ca-671b-4e31-8ce9-d748ed484aac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:39Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Creating volume db12c4ca-671b-4e31-8ce9-d748ed484aac {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.073s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:39 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:17:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:17:40 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac 1073741824 Sep 28 12:17:40 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:41 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac 1073741824" returned: 0 in 1.631s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:41 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac Sep 28 12:17:41 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:42 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac" returned: 0 in 0.962s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] <== create_volume: return (2798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.825s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66e6ecba-ebec-47c5-8399-9e61e61bcc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db12c4ca-671b-4e31-8ce9-d748ed484aac', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674e1385-c2bf-494c-9bc3-df6944519c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:42 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Volume volume-db12c4ca-671b-4e31-8ce9-d748ed484aac (db12c4ca-671b-4e31-8ce9-d748ed484aac): created successfully Sep 28 12:17:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (674e1385-c2bf-494c-9bc3-df6944519c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (dba015e3-df70-4119-b228-6b5f8766d822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:42 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-bdeb7c4c-a907-410b-bfc8-e7ac2471af05 tempest-VolumesActionsTest-957997759 None] Created volume successfully. Sep 28 12:17:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cf732d4e-8197-459e-83e4-65b7c1d33749 tempest-VolumesActionsTest-957997759 None] Acquiring lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac" by "attach_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-f2a434e6-7827-404b-b27d-fd4fe9cd2b8f req-6bdb238e-ebc3-4bbb-bb0c-238c60becdd2 tempest-AttachVolumeTestJSON-1586863211 None] Terminate volume connection completed successfully. Sep 28 12:17:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-f2a434e6-7827-404b-b27d-fd4fe9cd2b8f req-6bdb238e-ebc3-4bbb-bb0c-238c60becdd2 tempest-AttachVolumeTestJSON-1586863211 None] Deleting attachment 9d324ce8-187e-49d9-b522-73110ec7a844. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:17:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cf732d4e-8197-459e-83e4-65b7c1d33749 tempest-VolumesActionsTest-957997759 None] Lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac" acquired by "attach_volume" :: waited 0.046s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-cf732d4e-8197-459e-83e4-65b7c1d33749 tempest-VolumesActionsTest-957997759 None] Attaching volume db12c4ca-671b-4e31-8ce9-d748ed484aac to instance eb40af13-ba96-4d8f-92b2-6f7e9f8eadff at mountpoint /dev/vdb on host None. Sep 28 12:17:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-cf732d4e-8197-459e-83e4-65b7c1d33749 tempest-VolumesActionsTest-957997759 None] Attach volume completed successfully. Sep 28 12:17:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cf732d4e-8197-459e-83e4-65b7c1d33749 tempest-VolumesActionsTest-957997759 None] Lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac" released by "attach_volume" :: held 0.304s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-af98af55-2508-4f74-88a8-315eb3a17dbc tempest-VolumesActionsTest-2106953949 None] Terminate volume connection completed successfully. Sep 28 12:17:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af98af55-2508-4f74-88a8-315eb3a17dbc tempest-VolumesActionsTest-2106953949 None] Acquiring lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac-detach_volume" by "detach_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af98af55-2508-4f74-88a8-315eb3a17dbc tempest-VolumesActionsTest-2106953949 None] Lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-af98af55-2508-4f74-88a8-315eb3a17dbc tempest-VolumesActionsTest-2106953949 None] Detaching volume db12c4ca-671b-4e31-8ce9-d748ed484aac from instance eb40af13-ba96-4d8f-92b2-6f7e9f8eadff. Sep 28 12:17:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-af98af55-2508-4f74-88a8-315eb3a17dbc tempest-VolumesActionsTest-2106953949 None] Detach volume completed successfully. Sep 28 12:17:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af98af55-2508-4f74-88a8-315eb3a17dbc tempest-VolumesActionsTest-2106953949 None] Lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac-detach_volume" released by "detach_volume" :: held 0.133s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c6d5e853-44e7-4acb-b68d-7ab1ee9f4869 tempest-VolumesActionsTest-957997759 None] Acquiring lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac-detach_volume" by "detach_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c6d5e853-44e7-4acb-b68d-7ab1ee9f4869 tempest-VolumesActionsTest-957997759 None] Lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac-detach_volume" acquired by "detach_volume" :: waited 0.059s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c6d5e853-44e7-4acb-b68d-7ab1ee9f4869 tempest-VolumesActionsTest-957997759 None] Volume detach called, but volume not attached. Sep 28 12:17:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c6d5e853-44e7-4acb-b68d-7ab1ee9f4869 tempest-VolumesActionsTest-957997759 None] Lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-838fdf30-38e8-478e-99cc-313e5a904d3c req-8b8d886d-4c7e-44de-854e-0f9dd5d21508 tempest-AttachVolumeTestJSON-1586863211 None] Terminate volume connection completed successfully. Sep 28 12:17:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-838fdf30-38e8-478e-99cc-313e5a904d3c req-8b8d886d-4c7e-44de-854e-0f9dd5d21508 tempest-AttachVolumeTestJSON-1586863211 None] Deleting attachment 24ffec03-3174-4d21-b396-78e52fe3e840. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:17:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Acquiring lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Acquiring lock "cinder-quobyte-db12c4ca-671b-4e31-8ce9-d748ed484aac" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Lock "cinder-quobyte-db12c4ca-671b-4e31-8ce9-d748ed484aac" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:47 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3372c797-351d-431f-85c8-4ef5a4e0c2e8]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:47 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac Sep 28 12:17:47 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:47 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac" returned: 0 in 0.561s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:47 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac Sep 28 12:17:47 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:48 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-db12c4ca-671b-4e31-8ce9-d748ed484aac" returned: 0 in 0.632s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Lock "cinder-quobyte-db12c4ca-671b-4e31-8ce9-d748ed484aac" released by "delete_volume" :: held 1.279s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:48 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Created reservations ['03b0a0b4-58fa-4920-9776-7e8b895b25c8', 'e88c0395-ce7a-4eb6-b273-33449aa8598f', '139f22fb-9b48-417e-b04e-c6eea1de974a', '290ce803-30da-45cd-8ce1-c1555c3580fa'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:17:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:48 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:17:48 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:49 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.929s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:49 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:17:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Deleted volume successfully. Sep 28 12:17:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-1420a230-4187-478c-a9ca-9dc4a048d29d tempest-VolumesActionsTest-957997759 None] Lock "cinder-db12c4ca-671b-4e31-8ce9-d748ed484aac-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (2a99e4e4-2dcd-4846-b9da-f66d3d802da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b6eb9-6839-4619-bbeb-03409bcbfc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e6b6eb9-6839-4619-bbeb-03409bcbfc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-585481168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425d8531-7569-4c83-95f2-77783738846d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:57Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4be173-18c5-4204-b802-26e4647882fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4be173-18c5-4204-b802-26e4647882fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9a7fa6-96f3-4527-b134-fa36a95d053b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9a7fa6-96f3-4527-b134-fa36a95d053b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425d8531-7569-4c83-95f2-77783738846d', 'volume_name': 'volume-425d8531-7569-4c83-95f2-77783738846d', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e146dc-6073-4d53-a6a4-d06634ebb80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e146dc-6073-4d53-a6a4-d06634ebb80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89881620-0ae6-4ec3-aa87-4bbc8c92de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:57 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Volume 425d8531-7569-4c83-95f2-77783738846d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425d8531-7569-4c83-95f2-77783738846d', 'volume_size': 1} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:17:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-585481168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425d8531-7569-4c83-95f2-77783738846d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:17:57Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Creating volume 425d8531-7569-4c83-95f2-77783738846d {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:17:57 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:17:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:57 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d 1073741824 Sep 28 12:17:57 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:58 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d 1073741824" returned: 0 in 0.596s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:58 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d Sep 28 12:17:58 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:17:58 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Sep 28 12:17:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d" returned: 0 in 0.287s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:17:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:17:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:17:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89881620-0ae6-4ec3-aa87-4bbc8c92de0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425d8531-7569-4c83-95f2-77783738846d', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d081e1e5-7fec-47a1-b717-8a81a7ceb53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:17:58 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Volume volume-425d8531-7569-4c83-95f2-77783738846d (425d8531-7569-4c83-95f2-77783738846d): created successfully Sep 28 12:17:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d081e1e5-7fec-47a1-b717-8a81a7ceb53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:17:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (2a99e4e4-2dcd-4846-b9da-f66d3d802da3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:17:58 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-52703745-a847-4a06-af54-392fecdf5834 tempest-VolumesActionsTest-957997759 None] Created volume successfully. Sep 28 12:17:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Acquiring lock "cinder-425d8531-7569-4c83-95f2-77783738846d-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-425d8531-7569-4c83-95f2-77783738846d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Acquiring lock "cinder-quobyte-425d8531-7569-4c83-95f2-77783738846d" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-quobyte-425d8531-7569-4c83-95f2-77783738846d" acquired by "delete_volume" :: waited 0.040s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:59 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[746d21d0-5fff-4f6e-bb1c-c08cc32382d0]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:17:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:17:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "cinder-3bab8520-0298-41e6-9b73-b2554c68d759-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:17:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-3bab8520-0298-41e6-9b73-b2554c68d759-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:17:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "cinder-quobyte-3bab8520-0298-41e6-9b73-b2554c68d759" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-quobyte-3bab8520-0298-41e6-9b73-b2554c68d759" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ba2a0-3e81-4cd4-b087-f0ca309a88d2]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:00 devstack sudo[94953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d Sep 28 12:18:00 devstack sudo[94953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:00 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759 Sep 28 12:18:00 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:00 devstack sudo[94953]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d" returned: 0 in 0.649s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:00 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d Sep 28 12:18:00 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:00 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759" returned: 0 in 0.701s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:00 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759 Sep 28 12:18:00 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:01 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-425d8531-7569-4c83-95f2-77783738846d" returned: 0 in 0.555s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-quobyte-425d8531-7569-4c83-95f2-77783738846d" released by "delete_volume" :: held 1.303s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:01 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Created reservations ['3754a24f-bc3b-404e-8d5f-dfb74f87d5c2', 'dbc1463d-db09-4a70-b15e-7f154b4ad995', '5c996894-cffd-449e-87d8-f73f178b6457', 'ed218a4c-816b-483c-bb62-1d1e14a27058'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3bab8520-0298-41e6-9b73-b2554c68d759" returned: 0 in 0.459s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-quobyte-3bab8520-0298-41e6-9b73-b2554c68d759" released by "delete_volume" :: held 1.257s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Created reservations ['cd521b86-2ec3-4c4a-83ab-13b2fa973320', 'b30a8c78-eb53-4a05-a1a9-11620846a2c3', 'a22236c6-4876-4e63-b312-651aed55fc82', 'a07b56fe-1131-4d55-9620-aef7fa5c6cbc'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:01 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:18:01 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:01 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:18:01 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:01 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.420s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Deleted volume successfully. Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5c78686d-2292-4a84-b753-0f04cfe916c2 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-425d8531-7569-4c83-95f2-77783738846d-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:01 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.312s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Deleted volume successfully. Sep 28 12:18:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a81821a5-8ba1-4973-8b7b-561b270e234e tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-3bab8520-0298-41e6-9b73-b2554c68d759-delete_volume" released by "delete_volume" :: held 2.015s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "cinder-aea901e7-2363-49bb-98a2-aa24f964ed44-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-aea901e7-2363-49bb-98a2-aa24f964ed44-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "cinder-quobyte-aea901e7-2363-49bb-98a2-aa24f964ed44" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-quobyte-aea901e7-2363-49bb-98a2-aa24f964ed44" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[04db582c-206a-4e82-b312-876ad4aeaa3a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:02 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44 Sep 28 12:18:02 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (a6c6bb8f-dd2e-447b-a188-a133c68c2d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4997e257-c2ea-4066-9258-bcd8df19a53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4997e257-c2ea-4066-9258-bcd8df19a53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708611131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1556ddfb-3147-4e63-852a-27bb8bb2fca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:03Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f92ae8-8894-4ca2-a178-f081bbd0a2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f92ae8-8894-4ca2-a178-f081bbd0a2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fd9616-3f7c-4f0e-9d83-419c901a5434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86fd9616-3f7c-4f0e-9d83-419c901a5434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1556ddfb-3147-4e63-852a-27bb8bb2fca3', 'volume_name': 'volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736c7dd0-6268-411d-bae4-fa5985a4d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736c7dd0-6268-411d-bae4-fa5985a4d318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce1cc79-e32b-41dc-aaa1-a275cfa285a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:02 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Volume 1556ddfb-3147-4e63-852a-27bb8bb2fca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3', 'volume_size': 1} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708611131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1556ddfb-3147-4e63-852a-27bb8bb2fca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:03Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Creating volume 1556ddfb-3147-4e63-852a-27bb8bb2fca3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:02 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:18:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:02 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 1073741824 Sep 28 12:18:02 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:03 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44" returned: 0 in 0.583s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:03 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44 Sep 28 12:18:03 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:03 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aea901e7-2363-49bb-98a2-aa24f964ed44" returned: 0 in 0.550s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-quobyte-aea901e7-2363-49bb-98a2-aa24f964ed44" released by "delete_volume" :: held 1.214s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:03 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 1073741824" returned: 0 in 0.792s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Created reservations ['55073735-e71d-4611-b023-eff4a6e8ec1e', 'c0e30c4d-5793-43be-9a56-82740875dd16', 'b8d7d023-ffb2-4bc9-87d8-c4f266c9fe4f', 'a67d62ce-626b-412a-baf4-b6b79d57d928'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:03 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 Sep 28 12:18:03 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:03 devstack sudo[95003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:18:03 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:04 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3" returned: 0 in 0.347s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce1cc79-e32b-41dc-aaa1-a275cfa285a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408d83a4-f852-428b-9cd7-1350ad9be1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:04 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Volume volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 (1556ddfb-3147-4e63-852a-27bb8bb2fca3): created successfully Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408d83a4-f852-428b-9cd7-1350ad9be1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (a6c6bb8f-dd2e-447b-a188-a133c68c2d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-16781715-0117-4f3e-8572-250768909a20 tempest-VolumesActionsTest-957997759 None] Created volume successfully. Sep 28 12:18:04 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.409s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Deleted volume successfully. Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fc0a4e9c-afc6-4896-a9ca-4797e0a5c268 tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-aea901e7-2363-49bb-98a2-aa24f964ed44-delete_volume" released by "delete_volume" :: held 2.013s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "cinder-6b7e2c67-db08-454f-817e-e059c9836109-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-6b7e2c67-db08-454f-817e-e059c9836109-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "cinder-quobyte-6b7e2c67-db08-454f-817e-e059c9836109" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-quobyte-6b7e2c67-db08-454f-817e-e059c9836109" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[abebe33a-63fb-47d9-91b5-f7d87f4a0ebd]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:05 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109 Sep 28 12:18:05 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Acquiring lock "cinder-1556ddfb-3147-4e63-852a-27bb8bb2fca3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-1556ddfb-3147-4e63-852a-27bb8bb2fca3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Acquiring lock "cinder-quobyte-1556ddfb-3147-4e63-852a-27bb8bb2fca3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-quobyte-1556ddfb-3147-4e63-852a-27bb8bb2fca3" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[89218fc6-baf0-488d-be10-8c09820f9b92]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:05 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109" returned: 0 in 0.551s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:05 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109 Sep 28 12:18:05 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:05 devstack sudo[95012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 Sep 28 12:18:05 devstack sudo[95012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:05 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6b7e2c67-db08-454f-817e-e059c9836109" returned: 0 in 0.325s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-quobyte-6b7e2c67-db08-454f-817e-e059c9836109" released by "delete_volume" :: held 0.938s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=84,cinder:INSERT=24,cinder:UPDATE=91,cinder:DELETE=6 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:18:05 devstack sudo[95012]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3" returned: 0 in 0.412s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:05 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=92,cinder:INSERT=22,cinder:UPDATE=103,cinder:DELETE=9 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:18:05 devstack sudo[95020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3 Sep 28 12:18:05 devstack sudo[95020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:06 devstack sudo[95020]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1556ddfb-3147-4e63-852a-27bb8bb2fca3" returned: 0 in 0.321s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-quobyte-1556ddfb-3147-4e63-852a-27bb8bb2fca3" released by "delete_volume" :: held 0.790s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:08 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Created reservations ['1890bc33-3778-4f5e-93b9-916a6bf783a7', '923e2906-10db-4798-933e-d0f88b6bf727', '268e99ae-4c87-4f0c-9a96-618260000875', 'e5329f3e-ed3a-4ab3-892f-10f2b52dbaac'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:08 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Created reservations ['c41dbe3c-e56d-4809-a103-ab07d3ce9961', '07e8dd79-94c7-4d31-9c81-9fb2a5c8957e', 'c34f8af0-4059-43d0-af15-d0defc37f896', '1829024a-3e09-4d02-a802-fe9c4fc85bcd'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:13 devstack sudo[95024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:18:13 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:13 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:18:13 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:13 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.506s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Deleted volume successfully. Sep 28 12:18:13 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-957a1b56-ce90-404f-ae7a-754341e8bb23 tempest-AttachVolumeTestJSON-1586863211 None] Lock "cinder-6b7e2c67-db08-454f-817e-e059c9836109-delete_volume" released by "delete_volume" :: held 9.011s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.636s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Deleted volume successfully. Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c501620b-9e0a-4a12-ba60-4619a4150d39 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-1556ddfb-3147-4e63-852a-27bb8bb2fca3-delete_volume" released by "delete_volume" :: held 8.579s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (f4551c98-dd06-4b2a-87a4-0717e352f384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef710992-c47e-41d4-8185-192f0b7a9285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef710992-c47e-41d4-8185-192f0b7a9285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1594795637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1e0e65-d681-4853-9422-6b138759df39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:14Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a69779-f067-4f38-8148-a6a28784eef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5a69779-f067-4f38-8148-a6a28784eef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f67f43-9696-47a5-b0ac-5cd2e296f6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05f67f43-9696-47a5-b0ac-5cd2e296f6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1e0e65-d681-4853-9422-6b138759df39', 'volume_name': 'volume-7a1e0e65-d681-4853-9422-6b138759df39', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad5e59a-269b-4cf0-8359-744a1de69362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ad5e59a-269b-4cf0-8359-744a1de69362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c816f8c-1bd8-44e3-b037-3bc0a5cb390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:13 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Volume 7a1e0e65-d681-4853-9422-6b138759df39: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1e0e65-d681-4853-9422-6b138759df39', 'volume_size': 1} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1594795637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1e0e65-d681-4853-9422-6b138759df39,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:14Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Creating volume 7a1e0e65-d681-4853-9422-6b138759df39 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:13 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:18:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:14 devstack sudo[95031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39 1073741824 Sep 28 12:18:14 devstack sudo[95031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:14 devstack sudo[95031]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39 1073741824" returned: 0 in 0.497s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:14 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39 Sep 28 12:18:14 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:14 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39" returned: 0 in 0.314s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c816f8c-1bd8-44e3-b037-3bc0a5cb390a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1e0e65-d681-4853-9422-6b138759df39', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8807a464-cfd5-4147-8709-3465ed59c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:14 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Volume volume-7a1e0e65-d681-4853-9422-6b138759df39 (7a1e0e65-d681-4853-9422-6b138759df39): created successfully Sep 28 12:18:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8807a464-cfd5-4147-8709-3465ed59c30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (f4551c98-dd06-4b2a-87a4-0717e352f384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:14 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b05acea4-70b2-4785-99df-9b2f8abd16de tempest-VolumesActionsTest-957997759 None] Created volume successfully. Sep 28 12:18:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Acquiring lock "cinder-7a1e0e65-d681-4853-9422-6b138759df39-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-7a1e0e65-d681-4853-9422-6b138759df39-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Acquiring lock "cinder-quobyte-7a1e0e65-d681-4853-9422-6b138759df39" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-quobyte-7a1e0e65-d681-4853-9422-6b138759df39" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:16 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d16f687-1374-40f1-a4a9-f3f6cb58f6a3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:16 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39 Sep 28 12:18:16 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:16 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39" returned: 0 in 0.425s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:16 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39 Sep 28 12:18:16 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:16 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a1e0e65-d681-4853-9422-6b138759df39" returned: 0 in 0.293s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-quobyte-7a1e0e65-d681-4853-9422-6b138759df39" released by "delete_volume" :: held 0.781s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Created reservations ['325aeb8f-fd3c-4386-b7e9-ec9e45fbcc32', '8be23edf-a6b3-438e-a63c-bd9336e7e4fd', 'b18c9ce1-de3b-4060-a988-1fc8bc254fb6', '5110f618-d986-4f25-8409-abb6ec5b5652'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:17 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:18:17 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:17 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.352s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Deleted volume successfully. Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6e450372-c9bb-4daa-bd7c-e525cca9be22 tempest-VolumesActionsTest-2106953949 None] Lock "cinder-7a1e0e65-d681-4853-9422-6b138759df39-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:17 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (3cfe5046-cf30-488b-9d7b-79340013ed07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f8b1f3-55b4-49e9-8046-bdcc43ae3d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35f8b1f3-55b4-49e9-8046-bdcc43ae3d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009661643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2016253d-8b66-4c08-b23b-3735f1720b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:18Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09f907b-eb98-4b74-b5eb-6b5bcb6bc52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b09f907b-eb98-4b74-b5eb-6b5bcb6bc52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647fc68a-2754-4699-b5a2-eb00c9010ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (647fc68a-2754-4699-b5a2-eb00c9010ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2016253d-8b66-4c08-b23b-3735f1720b8b', 'volume_name': 'volume-2016253d-8b66-4c08-b23b-3735f1720b8b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2646815b-906b-429f-9513-185b1d911d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2646815b-906b-429f-9513-185b1d911d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c866ecbf-cfbd-483e-bf04-2e6f805d6dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Volume 2016253d-8b66-4c08-b23b-3735f1720b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2016253d-8b66-4c08-b23b-3735f1720b8b', 'volume_size': 1} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2009661643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2016253d-8b66-4c08-b23b-3735f1720b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:18Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Creating volume 2016253d-8b66-4c08-b23b-3735f1720b8b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:18 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:18 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b 1073741824 Sep 28 12:18:18 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:18 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b 1073741824" returned: 0 in 0.597s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:18 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b Sep 28 12:18:18 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:19 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b" returned: 0 in 0.427s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c866ecbf-cfbd-483e-bf04-2e6f805d6dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2016253d-8b66-4c08-b23b-3735f1720b8b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81a3135-e915-416b-8f89-07b51cc86a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:19 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Volume volume-2016253d-8b66-4c08-b23b-3735f1720b8b (2016253d-8b66-4c08-b23b-3735f1720b8b): created successfully Sep 28 12:18:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d81a3135-e915-416b-8f89-07b51cc86a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (3cfe5046-cf30-488b-9d7b-79340013ed07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:19 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6899721e-a6fd-4dba-b039-cc0d36d63afd tempest-VolumesActionsTest-957997759 None] Created volume successfully. Sep 28 12:18:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Acquiring lock "cinder-2016253d-8b66-4c08-b23b-3735f1720b8b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Lock "cinder-2016253d-8b66-4c08-b23b-3735f1720b8b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Acquiring lock "cinder-quobyte-2016253d-8b66-4c08-b23b-3735f1720b8b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Lock "cinder-quobyte-2016253d-8b66-4c08-b23b-3735f1720b8b" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:20 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b00bd5-477d-4580-8440-71cca45ff6e3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:20 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b Sep 28 12:18:20 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:20 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b" returned: 0 in 0.416s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:20 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b Sep 28 12:18:20 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:21 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2016253d-8b66-4c08-b23b-3735f1720b8b" returned: 0 in 0.424s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Lock "cinder-quobyte-2016253d-8b66-4c08-b23b-3735f1720b8b" released by "delete_volume" :: held 0.921s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Created reservations ['cd617ab4-82c0-49a5-96d3-5d0704fc6bb4', 'ef4e397f-f6aa-4620-8631-1c5b1b8dfbdc', '4215b316-e0de-41cc-a303-24a506b7f51d', 'b6e9b849-01d5-46e3-bec8-75b74986140b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:21 devstack sudo[95072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:18:21 devstack sudo[95072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:21 devstack sudo[95072]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.363s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:21 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Deleted volume successfully. Sep 28 12:18:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c2f62d7-51cb-4582-a2dc-050dd4f4414d tempest-VolumesActionsTest-2106953949 None] Lock "cinder-2016253d-8b66-4c08-b23b-3735f1720b8b-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (6e36de66-03d3-49a8-b97a-e712c71bd5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333ba2e8-deb6-4394-85b5-8d2b352f34f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (333ba2e8-deb6-4394-85b5-8d2b352f34f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-700968047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7dd3ed-7b2f-43a6-a772-53d921a74e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:22Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02405395-e4b9-4ed8-8d4e-66cbda9ca314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02405395-e4b9-4ed8-8d4e-66cbda9ca314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6b0f02-f2b3-47a9-af45-b5e86416395c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd6b0f02-f2b3-47a9-af45-b5e86416395c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d7dd3ed-7b2f-43a6-a772-53d921a74e94', 'volume_name': 'volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf28db1e-644c-4019-b51b-c026e9d3c8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf28db1e-644c-4019-b51b-c026e9d3c8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59de8110-2ad4-4d6b-b951-f0d6db169134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:22 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Volume 9d7dd3ed-7b2f-43a6-a772-53d921a74e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94', 'volume_size': 1} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-700968047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d7dd3ed-7b2f-43a6-a772-53d921a74e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1e5821f5274764b485d249d5a4568d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:22Z,use_quota=True,user_id='2889ca5f24f149f69846f79053c53a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Creating volume 9d7dd3ed-7b2f-43a6-a772-53d921a74e94 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:22 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:18:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:22 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 1073741824 Sep 28 12:18:22 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:23 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 1073741824" returned: 0 in 0.592s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:23 devstack sudo[95081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 Sep 28 12:18:23 devstack sudo[95081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:23 devstack sudo[95081]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94" returned: 0 in 0.362s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59de8110-2ad4-4d6b-b951-f0d6db169134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5984da3-fd82-4d60-a41d-a3bb1b52aace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:23 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Volume volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 (9d7dd3ed-7b2f-43a6-a772-53d921a74e94): created successfully Sep 28 12:18:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5984da3-fd82-4d60-a41d-a3bb1b52aace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Flow 'volume_create_manager' (6e36de66-03d3-49a8-b97a-e712c71bd5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:23 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-413418b3-922f-498a-b2ef-f5a56a48a154 tempest-VolumesActionsTest-957997759 None] Created volume successfully. Sep 28 12:18:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Acquiring lock "cinder-9d7dd3ed-7b2f-43a6-a772-53d921a74e94-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Lock "cinder-9d7dd3ed-7b2f-43a6-a772-53d921a74e94-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Acquiring lock "cinder-quobyte-9d7dd3ed-7b2f-43a6-a772-53d921a74e94" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Lock "cinder-quobyte-9d7dd3ed-7b2f-43a6-a772-53d921a74e94" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c81a010-45a7-45aa-8e5c-cccc795d242a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:25 devstack sudo[95085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 Sep 28 12:18:25 devstack sudo[95085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:26 devstack sudo[95085]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94" returned: 0 in 0.500s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:26 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94 Sep 28 12:18:26 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:26 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d7dd3ed-7b2f-43a6-a772-53d921a74e94" returned: 0 in 0.413s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Lock "cinder-quobyte-9d7dd3ed-7b2f-43a6-a772-53d921a74e94" released by "delete_volume" :: held 1.018s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Created reservations ['dc7fb235-71e9-4c5b-9669-e842ead7fb9b', '9d1e35f9-cc44-4f20-8ecc-8ff47ed2c0a6', 'cdd6207b-c358-4022-b601-f8bee5456c9a', '8730d4e2-6a49-4b29-a109-1a9f0970ca2f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:26 devstack sudo[95096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:18:26 devstack sudo[95096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:27 devstack sudo[95096]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.359s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:27 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Deleted volume successfully. Sep 28 12:18:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6cbf6dd-3d0b-406c-b976-99c062afcab5 tempest-VolumesActionsTest-957997759 None] Lock "cinder-9d7dd3ed-7b2f-43a6-a772-53d921a74e94-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Flow 'volume_create_manager' (ab24ac33-f54a-459c-89be-8364215391df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a42c7f-2e0f-4141-bc6b-d140cd2b4dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36a42c7f-2e0f-4141-bc6b-d140cd2b4dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1970451593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82acde7f-1e30-49cd-a5a8-6176e606f4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4026b63c3a8413cb758d772c620f206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:32Z,use_quota=True,user_id='56218a39149a4229bf27a66717cb6a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31b3517e-98ee-4c65-9b02-d4d5c791942b),volume_type_id=31b3517e-98ee-4c65-9b02-d4d5c791942b)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a2b5b8-ce81-4534-bf43-9e36636b3695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a2b5b8-ce81-4534-bf43-9e36636b3695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77921153-ef62-430e-a062-b9930b364a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77921153-ef62-430e-a062-b9930b364a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82acde7f-1e30-49cd-a5a8-6176e606f4c3', 'volume_name': 'volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ecbea9-7944-4239-b381-81f83f9ba010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ecbea9-7944-4239-b381-81f83f9ba010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1326322e-a931-496b-ba4f-4b4fd5619318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:32 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Volume 82acde7f-1e30-49cd-a5a8-6176e606f4c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3', 'volume_size': 1} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1970451593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82acde7f-1e30-49cd-a5a8-6176e606f4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4026b63c3a8413cb758d772c620f206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:32Z,use_quota=True,user_id='56218a39149a4229bf27a66717cb6a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31b3517e-98ee-4c65-9b02-d4d5c791942b),volume_type_id=31b3517e-98ee-4c65-9b02-d4d5c791942b)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Creating volume 82acde7f-1e30-49cd-a5a8-6176e606f4c3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:32 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:32 devstack sudo[95102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 1073741824 Sep 28 12:18:32 devstack sudo[95102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:32 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Flow 'volume_create_manager' (984d0276-0e35-4534-8df4-e4c9b20af771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578a2f45-1f13-4daa-a3c7-6f1b476cabb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (578a2f45-1f13-4daa-a3c7-6f1b476cabb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-349024765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123c6f9a-e4e8-4549-84b7-79dc15339b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4026b63c3a8413cb758d772c620f206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:33Z,use_quota=True,user_id='56218a39149a4229bf27a66717cb6a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e8b4739-567c-405b-8ff0-49047e693dc1),volume_type_id=9e8b4739-567c-405b-8ff0-49047e693dc1)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b49c11-0e30-4c8a-9cbf-40328e73d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4b49c11-0e30-4c8a-9cbf-40328e73d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d1670e-f47c-4e25-8d86-41d3474f2d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d1670e-f47c-4e25-8d86-41d3474f2d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '123c6f9a-e4e8-4549-84b7-79dc15339b8f', 'volume_name': 'volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68bb9a1-128e-47e3-aadc-6806602004a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68bb9a1-128e-47e3-aadc-6806602004a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15d1c54-7045-421f-bde6-91402f66f434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:33 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Volume 123c6f9a-e4e8-4549-84b7-79dc15339b8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f', 'volume_size': 1} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:33 devstack sudo[95102]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 1073741824" returned: 0 in 0.911s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:33 devstack sudo[95108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 Sep 28 12:18:33 devstack sudo[95108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:33 devstack sudo[95108]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3" returned: 0 in 0.404s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.570s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-349024765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=123c6f9a-e4e8-4549-84b7-79dc15339b8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4026b63c3a8413cb758d772c620f206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:33Z,use_quota=True,user_id='56218a39149a4229bf27a66717cb6a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e8b4739-567c-405b-8ff0-49047e693dc1),volume_type_id=9e8b4739-567c-405b-8ff0-49047e693dc1)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Creating volume 123c6f9a-e4e8-4549-84b7-79dc15339b8f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:33 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:33 devstack sudo[95111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f 1073741824 Sep 28 12:18:33 devstack sudo[95111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1326322e-a931-496b-ba4f-4b4fd5619318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec855d3-cb25-477c-ae46-e332d24a61d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Flow 'volume_create_manager' (645dedc9-e766-4138-9054-649c3cb77d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bafcb9-5775-4d3b-bfa8-b4b4ea2cf189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:33 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Volume volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 (82acde7f-1e30-49cd-a5a8-6176e606f4c3): created successfully Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec855d3-cb25-477c-ae46-e332d24a61d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Flow 'volume_create_manager' (ab24ac33-f54a-459c-89be-8364215391df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-99f86d30-f07b-432d-8e0a-7d4543649ce9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Created volume successfully. Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6bafcb9-5775-4d3b-bfa8-b4b4ea2cf189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-993198539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c97ecd7-8366-4112-8fe4-75f8fa64b775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4026b63c3a8413cb758d772c620f206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:34Z,use_quota=True,user_id='56218a39149a4229bf27a66717cb6a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244bac3a-b4d1-4ece-bc85-696b0154db1b),volume_type_id=244bac3a-b4d1-4ece-bc85-696b0154db1b)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd41778-da74-45e1-9e0a-20009df3d9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fd41778-da74-45e1-9e0a-20009df3d9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee011ea-7855-4241-af5a-5e1538d2bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:18:34 devstack sudo[95111]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f 1073741824" returned: 0 in 0.819s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:34 devstack sudo[95116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f Sep 28 12:18:34 devstack sudo[95116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ee011ea-7855-4241-af5a-5e1538d2bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c97ecd7-8366-4112-8fe4-75f8fa64b775', 'volume_name': 'volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775', 'volume_size': 1, 'image_id': '6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1546089959', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f4026b63c3a8413cb758d772c620f206', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'created_at': datetime.datetime(2026, 9, 28, 10, 18, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 18, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6df3bbc0-a883-4569-a1d8-5f00c41c19ed/file', 'properties': {}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0535950-9e20-40ed-b230-f34d57fd4b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0535950-9e20-40ed-b230-f34d57fd4b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0145e7e-ec62-4411-9ad9-2bbca4418d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:34 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Volume 9c97ecd7-8366-4112-8fe4-75f8fa64b775: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775', 'volume_size': 1, 'image_id': '6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1546089959', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f4026b63c3a8413cb758d772c620f206', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'created_at': datetime.datetime(2026, 9, 28, 10, 18, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 18, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6df3bbc0-a883-4569-a1d8-5f00c41c19ed/file', 'properties': {}}, 'image_service': } Sep 28 12:18:34 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Trying to clone 9c97ecd7-8366-4112-8fe4-75f8fa64b775 from image 6df3bbc0-a883-4569-a1d8-5f00c41c19ed at location (None, [{'url': 'file:///opt/stack/data/glance/images/6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:18:35 devstack sudo[95116]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f" returned: 0 in 0.525s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d15d1c54-7045-421f-bde6-91402f66f434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb86079-59b0-4247-bbf7-fb44ef0a35e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:35 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Volume volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f (123c6f9a-e4e8-4549-84b7-79dc15339b8f): created successfully Sep 28 12:18:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb86079-59b0-4247-bbf7-fb44ef0a35e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Flow 'volume_create_manager' (984d0276-0e35-4534-8df4-e4c9b20af771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-96df3865-dc43-45e5-ab28-818bb0459089 tempest-TestInstancesWithCinderVolumes-1545191425 None] Created volume successfully. Sep 28 12:18:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:18:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:38 devstack sudo[95124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:18:38 devstack sudo[95124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:38 devstack sudo[95124]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.534s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:18:40 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD, size 20.69 MB, duration 5.30 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:18:40 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Image download 20.69 MB at 3.91 MB/s Sep 28 12:18:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe38d2fe-e33d-4ee2-8a42-1d97afaa062f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:40 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD Sep 28 12:18:40 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:40 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD" returned: 0 in 0.416s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:40 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Temporary image 6df3bbc0-a883-4569-a1d8-5f00c41c19ed is fetched for user 56218a39149a4229bf27a66717cb6a78. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:18:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29e357a-ec74-4df4-a3c5-971b47aef472]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:41 devstack sudo[95153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD Sep 28 12:18:41 devstack sudo[95153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:41 devstack sudo[95153]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-993198539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c97ecd7-8366-4112-8fe4-75f8fa64b775,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4026b63c3a8413cb758d772c620f206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:34Z,use_quota=True,user_id='56218a39149a4229bf27a66717cb6a78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244bac3a-b4d1-4ece-bc85-696b0154db1b),volume_type_id=244bac3a-b4d1-4ece-bc85-696b0154db1b)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Creating volume 9c97ecd7-8366-4112-8fe4-75f8fa64b775 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:41 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:41 devstack sudo[95158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 1073741824 Sep 28 12:18:41 devstack sudo[95158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:41 devstack sudo[95158]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 1073741824" returned: 0 in 0.614s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:42 devstack sudo[95164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 Sep 28 12:18:42 devstack sudo[95164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:42 devstack sudo[95164]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775" returned: 0 in 0.301s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:42 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Attempting download of 6df3bbc0-a883-4569-a1d8-5f00c41c19ed ((None, [{'url': 'file:///opt/stack/data/glance/images/6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'metadata': {}}])) to volume 9c97ecd7-8366-4112-8fe4-75f8fa64b775. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:18:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[68217d12-96a8-454e-9e3a-ec38a1ea55cb]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6df3bbc0-a883-4569-a1d8-5f00c41c19ed_8fnbhybf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:42 devstack sudo[95167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6df3bbc0-a883-4569-a1d8-5f00c41c19ed_8fnbhybf Sep 28 12:18:42 devstack sudo[95167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:42 devstack sudo[95167]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6df3bbc0-a883-4569-a1d8-5f00c41c19ed_8fnbhybf" returned: 0 in 0.590s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6df3bbc0-a883-4569-a1d8-5f00c41c19ed_8fnbhybf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:43 devstack sudo[95203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6df3bbc0-a883-4569-a1d8-5f00c41c19ed_8fnbhybf Sep 28 12:18:43 devstack sudo[95203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-37c241ce-9f06-44af-8312-8d3f6c016f46 tempest-GroupsV314Test-1528211538 None] Group tempest-GroupsV314Test-Group-1332605328: creating Sep 28 12:18:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-37c241ce-9f06-44af-8312-8d3f6c016f46 tempest-GroupsV314Test-1528211538 None] Group tempest-GroupsV314Test-Group-1332605328: created successfully Sep 28 12:18:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-37c241ce-9f06-44af-8312-8d3f6c016f46 tempest-GroupsV314Test-1528211538 None] Create group completed successfully. Sep 28 12:18:43 devstack sudo[95203]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6df3bbc0-a883-4569-a1d8-5f00c41c19ed_8fnbhybf" returned: 1 in 0.697s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6df3bbc0-a883-4569-a1d8-5f00c41c19ed_8fnbhybf' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:18:43 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e92772a-f6c7-4105-9ddb-e6b5207c3f89]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:43 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD Sep 28 12:18:43 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:44 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:44 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] 6df3bbc0-a883-4569-a1d8-5f00c41c19ed was qcow2, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:18:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:44 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 Sep 28 12:18:44 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Flow 'volume_create_manager' (a55baa5f-6db3-4fc3-b1af-fe591a38de06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7a610-4cdc-4841-ab75-ffb0faead222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fad7a610-4cdc-4841-ab75-ffb0faead222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-387141582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1cdc17c1-89c6-412c-801c-d45a6890e6a3,host='devstack@QuobyteHD#QuobyteHD',id=2e3daeae-2c13-4bc5-8f23-d578ae36e0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f48bff418a0434cba400494c8427c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:46Z,use_quota=True,user_id='cebcb193b85940d38ad5a89938abeb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30e01153-639f-4f51-b76b-02357d96eaf7),volume_type_id=30e01153-639f-4f51-b76b-02357d96eaf7)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3047ba40-5dbf-40e9-af4a-385881d9cfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3047ba40-5dbf-40e9-af4a-385881d9cfdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcfdac1-8ce4-47b3-a9a3-ca7fa7413115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fcfdac1-8ce4-47b3-a9a3-ca7fa7413115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e3daeae-2c13-4bc5-8f23-d578ae36e0db', 'volume_name': 'volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95390eca-a36e-47b7-b283-04838ffd5238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95390eca-a36e-47b7-b283-04838ffd5238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cd723f-d1e5-4d1c-9b3c-551a47dd6fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:45 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Volume 2e3daeae-2c13-4bc5-8f23-d578ae36e0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db', 'volume_size': 1} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1cdc17c1-89c6-412c-801c-d45a6890e6a3,created_at=2026-09-28T10:18:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-387141582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1cdc17c1-89c6-412c-801c-d45a6890e6a3,host='devstack@QuobyteHD#QuobyteHD',id=2e3daeae-2c13-4bc5-8f23-d578ae36e0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f48bff418a0434cba400494c8427c87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:18:46Z,use_quota=True,user_id='cebcb193b85940d38ad5a89938abeb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(30e01153-639f-4f51-b76b-02357d96eaf7),volume_type_id=30e01153-639f-4f51-b76b-02357d96eaf7)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Creating volume 2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:18:45 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:18:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:45 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db 1073741824 Sep 28 12:18:45 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:46 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db 1073741824" returned: 0 in 0.962s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:46 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db Sep 28 12:18:46 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:47 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db" returned: 0 in 0.492s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91cd723f-d1e5-4d1c-9b3c-551a47dd6fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a73e1a-fc09-4368-a966-f8f576b241ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:47 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Volume volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db (2e3daeae-2c13-4bc5-8f23-d578ae36e0db): created successfully Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3a73e1a-fc09-4368-a966-f8f576b241ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Flow 'volume_create_manager' (a55baa5f-6db3-4fc3-b1af-fe591a38de06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:47 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-838137e3-48ca-490c-bd9a-79ae2ae31bac tempest-GroupsV314Test-1528211538 None] Created volume successfully. Sep 28 12:18:47 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775" returned: 0 in 3.590s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6df3bbc0-a883-4569-a1d8-5f00c41c19ed__dk1dv9sdevstack@QuobyteHD, size 112.00 MB, duration 3.59 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:18:47 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Converted 112.00 MB image at 31.17 MB/s Sep 28 12:18:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:47 devstack sudo[95283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 1G Sep 28 12:18:47 devstack sudo[95283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:48 devstack sudo[95283]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 1G" returned: 0 in 0.605s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Downloaded image 6df3bbc0-a883-4569-a1d8-5f00c41c19ed ((None, [{'url': 'file:///opt/stack/data/glance/images/6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'metadata': {}}])) to volume 9c97ecd7-8366-4112-8fe4-75f8fa64b775 successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Temporary image 6df3bbc0-a883-4569-a1d8-5f00c41c19ed for user 56218a39149a4229bf27a66717cb6a78 is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Marking volume 9c97ecd7-8366-4112-8fe4-75f8fa64b775 as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Copying metadata from image 6df3bbc0-a883-4569-a1d8-5f00c41c19ed to 9c97ecd7-8366-4112-8fe4-75f8fa64b775. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Creating volume glance metadata for volume 9c97ecd7-8366-4112-8fe4-75f8fa64b775 backed by image 6df3bbc0-a883-4569-a1d8-5f00c41c19ed with: {'image_id': '6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'image_name': 'tempest-scenario-img--1546089959', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0145e7e-ec62-4411-9ad9-2bbca4418d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775', 'volume_size': 1, 'image_id': '6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1546089959', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f4026b63c3a8413cb758d772c620f206', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6df3bbc0-a883-4569-a1d8-5f00c41c19ed', 'created_at': datetime.datetime(2026, 9, 28, 10, 18, 28, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 18, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6df3bbc0-a883-4569-a1d8-5f00c41c19ed/file', 'properties': {}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539b9d3c-4283-4c64-8cf5-9bd1f3404caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:18:48 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Volume volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 (9c97ecd7-8366-4112-8fe4-75f8fa64b775): created successfully Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539b9d3c-4283-4c64-8cf5-9bd1f3404caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:18:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Flow 'volume_create_manager' (645dedc9-e766-4138-9054-649c3cb77d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:18:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-84fe65e3-b20d-4e5d-adf0-e01384fb5eb9 tempest-TestInstancesWithCinderVolumes-1545191425 None] Created volume successfully. Sep 28 12:18:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:49 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Cloning volume 2e3daeae-2c13-4bc5-8f23-d578ae36e0db to volume dd37c4fa-febb-47ee-83ad-12174487d965 Sep 28 12:18:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Creating offline snapshot 8e5230b0-6883-4253-b0c6-cafd38be396a of volume 2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:18:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef598a2-be27-4173-9313-7c9cf8a0f3d5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:49 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db Sep 28 12:18:49 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:50 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db" returned: 0 in 0.701s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:50 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a 1G Sep 28 12:18:50 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:51 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a 1G" returned: 0 in 0.980s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:51 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a Sep 28 12:18:51 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:51 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a" returned: 0 in 0.557s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:51 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:18:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:51 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a Sep 28 12:18:51 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:52 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a" returned: 0 in 0.462s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:52 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.info Sep 28 12:18:52 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:52 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.info" returned: 0 in 0.629s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:52 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:18:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:52 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.info Sep 28 12:18:52 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:53 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.info" returned: 0 in 0.723s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Acquiring lock "cinder-quobyte-dd37c4fa-febb-47ee-83ad-12174487d965" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Lock "cinder-quobyte-dd37c4fa-febb-47ee-83ad-12174487d965" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] snapshot: 8e5230b0-6883-4253-b0c6-cafd38be396a, volume: dd37c4fa-febb-47ee-83ad-12174487d965, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aff069a-761c-4b2f-8b78-7eda0cf287b7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:54 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a Sep 28 12:18:54 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:54 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a" returned: 0 in 1.164s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:18:55 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3912246-fb14-42c6-a890-561dc7fb6230]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:18:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:55 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db Sep 28 12:18:55 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:55 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Sep 28 12:18:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db" returned: 0 in 0.606s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:18:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:18:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:18:55 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:18:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:18:55 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 Sep 28 12:18:55 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:18:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-5b86fae3-6556-4c76-900b-d75814b7274a req-31c3293b-9492-4109-8a7c-9cdd4d81ea87 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Flow 'volume_create_manager' (878f5200-a1ed-4ca7-b9d1-05d7a02ddafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d19c57-ec1e-4c12-875e-c7cb48716b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0d19c57-ec1e-4c12-875e-c7cb48716b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1387495006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e3e3c8-e322-4a51-81c7-59c753285736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb337fe772184ff4be91d4130492c712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:01Z,use_quota=True,user_id='7adf249086ee467b989c7dacae47724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388dd677-fac2-4093-bcfc-fb6ac748d553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388dd677-fac2-4093-bcfc-fb6ac748d553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a81dfe-3ed3-4820-b128-0465db9ed405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04a81dfe-3ed3-4820-b128-0465db9ed405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e3e3c8-e322-4a51-81c7-59c753285736', 'volume_name': 'volume-20e3e3c8-e322-4a51-81c7-59c753285736', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13b4692-19ba-486c-8b5c-b636f9f92cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13b4692-19ba-486c-8b5c-b636f9f92cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb40fd99-1b95-4d3c-8f14-a955c0cb307f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:01 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Volume 20e3e3c8-e322-4a51-81c7-59c753285736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e3e3c8-e322-4a51-81c7-59c753285736', 'volume_size': 1} Sep 28 12:19:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:08 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965" returned: 0 in 12.758s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:08 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db, size 1024.00 MB, duration 12.76 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:19:08 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Converted 1024.00 MB image at 80.23 MB/s Sep 28 12:19:08 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:19:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:08 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 Sep 28 12:19:08 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:08 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965" returned: 0 in 0.497s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Lock "cinder-quobyte-dd37c4fa-febb-47ee-83ad-12174487d965" released by "_copy_volume_from_snapshot" :: held 15.217s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Acquiring lock "cinder-quobyte-8e5230b0-6883-4253-b0c6-cafd38be396a" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Lock "cinder-quobyte-8e5230b0-6883-4253-b0c6-cafd38be396a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Deleting offline snapshot 8e5230b0-6883-4253-b0c6-cafd38be396a of volume 2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:19:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] snapshot_file for this snap is: volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:19:09 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a65dcb7-f5dc-447d-8a6a-eaec82a95623]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:09 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a Sep 28 12:19:09 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:09 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a" returned: 0 in 0.694s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:19:09 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd64936-4db4-4293-af35-6366014311dc]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:10 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db Sep 28 12:19:10 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:10 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db" returned: 0 in 0.808s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:10 devstack sudo[95558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a Sep 28 12:19:10 devstack sudo[95558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:11 devstack sudo[95558]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a" returned: 0 in 0.471s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:11 devstack sudo[95566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a Sep 28 12:19:11 devstack sudo[95566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:11 devstack sudo[95566]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db.8e5230b0-6883-4253-b0c6-cafd38be396a" returned: 0 in 0.319s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Lock "cinder-quobyte-8e5230b0-6883-4253-b0c6-cafd38be396a" released by "_delete_snapshot" :: held 2.486s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.143s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-5b86fae3-6556-4c76-900b-d75814b7274a req-31c3293b-9492-4109-8a7c-9cdd4d81ea87 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.975s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-5b86fae3-6556-4c76-900b-d75814b7274a req-31c3293b-9492-4109-8a7c-9cdd4d81ea87 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.860s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1387495006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e3e3c8-e322-4a51-81c7-59c753285736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb337fe772184ff4be91d4130492c712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:01Z,use_quota=True,user_id='7adf249086ee467b989c7dacae47724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Creating volume 20e3e3c8-e322-4a51-81c7-59c753285736 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:11 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:11 devstack sudo[95569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736 1073741824 Sep 28 12:19:11 devstack sudo[95569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-5b86fae3-6556-4c76-900b-d75814b7274a req-31c3293b-9492-4109-8a7c-9cdd4d81ea87 tempest-TestInstancesWithCinderVolumes-1545191425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f728b5e-deb6-4579-8233-30d7a50ca54c', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:19:11 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-08332fe1-8213-490c-967f-0810ceff27c9 tempest-GroupsV314Test-1528211538 None] Create group from source-group-1cdc17c1-89c6-412c-801c-d45a6890e6a3 completed successfully. Sep 28 12:19:11 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-5b86fae3-6556-4c76-900b-d75814b7274a req-31c3293b-9492-4109-8a7c-9cdd4d81ea87 tempest-TestInstancesWithCinderVolumes-1545191425 None] attachment_update completed successfully. Sep 28 12:19:12 devstack sudo[95569]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736 1073741824" returned: 0 in 0.574s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:12 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736 Sep 28 12:19:12 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:12 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736" returned: 0 in 0.669s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb40fd99-1b95-4d3c-8f14-a955c0cb307f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e3e3c8-e322-4a51-81c7-59c753285736', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51c71d8-8c76-4370-9f72-f973f7bfb81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:13 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Volume volume-20e3e3c8-e322-4a51-81c7-59c753285736 (20e3e3c8-e322-4a51-81c7-59c753285736): created successfully Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51c71d8-8c76-4370-9f72-f973f7bfb81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Flow 'volume_create_manager' (878f5200-a1ed-4ca7-b9d1-05d7a02ddafc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4f191354-a932-411f-999a-c59141d93f06 tempest-VolumesListAdminTestJSON-632621251 None] Created volume successfully. Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=66,cinder:INSERT=23,cinder:UPDATE=83,cinder:DELETE=7 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:DELETE=6,cinder:SELECT=53,cinder:UPDATE=60,cinder:INSERT=16 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Flow 'volume_create_manager' (3422a0cd-96a8-420f-b267-3ec0b833609a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff0136a-69a8-455c-9686-fbfe7f23d004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Acquiring lock "cinder-quobyte-dd37c4fa-febb-47ee-83ad-12174487d965" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dff0136a-69a8-455c-9686-fbfe7f23d004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2049542208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d693a41d-8133-4aa7-91b3-4e683c092c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d082abf546d401a9cceca5e8aa28931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:14Z,use_quota=True,user_id='cbddb4e155a1436ab031179c0c36a24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9122f2d3-7443-48cf-896e-6f63a1498dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9122f2d3-7443-48cf-896e-6f63a1498dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff16405-7615-4e4b-9ecd-819013ae26a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff16405-7615-4e4b-9ecd-819013ae26a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd693a41d-8133-4aa7-91b3-4e683c092c31', 'volume_name': 'volume-d693a41d-8133-4aa7-91b3-4e683c092c31', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1e4e16-eadb-4e7f-b501-2cffbcfed6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e1e4e16-eadb-4e7f-b501-2cffbcfed6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6829ef5c-1a43-4c46-80a3-aee3fe85f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:14 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Volume d693a41d-8133-4aa7-91b3-4e683c092c31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d693a41d-8133-4aa7-91b3-4e683c092c31', 'volume_size': 1} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2049542208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d693a41d-8133-4aa7-91b3-4e683c092c31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d082abf546d401a9cceca5e8aa28931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:14Z,use_quota=True,user_id='cbddb4e155a1436ab031179c0c36a24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Creating volume d693a41d-8133-4aa7-91b3-4e683c092c31 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:14 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Lock "cinder-quobyte-dd37c4fa-febb-47ee-83ad-12174487d965" acquired by "delete_volume" :: waited 0.142s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:14 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31 1073741824 Sep 28 12:19:14 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db50c5a-8373-4412-9b8e-d7d91d5b4871]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:14 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 Sep 28 12:19:14 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:14 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965" returned: 0 in 0.534s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:14 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965 Sep 28 12:19:14 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:14 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31 1073741824" returned: 0 in 0.701s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:14 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31 Sep 28 12:19:14 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:15 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Flow 'volume_create_manager' (38279aaf-6b19-4fbc-ae9a-67a318fd749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9722cf42-8d2d-46e6-9978-3cb7b2f61909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dd37c4fa-febb-47ee-83ad-12174487d965" returned: 0 in 0.393s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9722cf42-8d2d-46e6-9978-3cb7b2f61909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-804108559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4275748f-d049-4176-87b3-a5619c968538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb337fe772184ff4be91d4130492c712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:15Z,use_quota=True,user_id='7adf249086ee467b989c7dacae47724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686b448d-9b06-4270-94d2-a9ce5c8064a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686b448d-9b06-4270-94d2-a9ce5c8064a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016a7994-07a5-425f-94e8-e9c25c5c177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (016a7994-07a5-425f-94e8-e9c25c5c177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4275748f-d049-4176-87b3-a5619c968538', 'volume_name': 'volume-4275748f-d049-4176-87b3-a5619c968538', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afcd6ef-7588-45ee-9f1c-8a2629618c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1afcd6ef-7588-45ee-9f1c-8a2629618c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18abdc7-b0fc-4efd-98c6-9b5e92d179ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:15 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Volume 4275748f-d049-4176-87b3-a5619c968538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4275748f-d049-4176-87b3-a5619c968538', 'volume_size': 1} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Lock "cinder-quobyte-dd37c4fa-febb-47ee-83ad-12174487d965" released by "delete_volume" :: held 1.073s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Created reservations ['ddd810ad-4afb-4816-8d1d-e84383bffa84'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:15 devstack cinder-volume[87048]: WARNING cinder.quota [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1616421280 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1616421280, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:19:15 devstack cinder-volume[87048]: WARNING cinder.quota [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1616421280 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1616421280, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:19:15 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31" returned: 0 in 0.463s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.149s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-804108559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4275748f-d049-4176-87b3-a5619c968538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb337fe772184ff4be91d4130492c712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:15Z,use_quota=True,user_id='7adf249086ee467b989c7dacae47724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Creating volume 4275748f-d049-4176-87b3-a5619c968538 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:15 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Created reservations ['9e0394b4-56b3-4b50-9465-246a996f02aa', '488d7d25-12f4-475d-b3f6-546b8a7a949d', '90262100-3c0d-4556-820f-a6d33cb3be61', 'e447028a-f5d9-4c30-8db2-1a6428f6cfcf'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6829ef5c-1a43-4c46-80a3-aee3fe85f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d693a41d-8133-4aa7-91b3-4e683c092c31', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:15 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538 1073741824 Sep 28 12:19:15 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e793e97a-46df-41f0-8721-4d38e85227b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:15 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Volume volume-d693a41d-8133-4aa7-91b3-4e683c092c31 (d693a41d-8133-4aa7-91b3-4e683c092c31): created successfully Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e793e97a-46df-41f0-8721-4d38e85227b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Flow 'volume_create_manager' (3422a0cd-96a8-420f-b267-3ec0b833609a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a7f26078-6bb0-4c5d-bb14-a9743be5bf62 tempest-ServersNegativeTestJSON-969943825 None] Created volume successfully. Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:15 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:15 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:15 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.335s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:15 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-49bc55d0-3d96-43a3-8be5-7b375a63020a tempest-GroupsV314Test-1528211538 None] Delete group completed successfully. Sep 28 12:19:16 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538 1073741824" returned: 0 in 0.739s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:16 devstack sudo[96095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538 Sep 28 12:19:16 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:16 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538" returned: 0 in 0.469s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] <== create_volume: return (1269ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b18abdc7-b0fc-4efd-98c6-9b5e92d179ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4275748f-d049-4176-87b3-a5619c968538', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19940e84-64ad-4f69-8c9d-d0df374e18ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:16 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Volume volume-4275748f-d049-4176-87b3-a5619c968538 (4275748f-d049-4176-87b3-a5619c968538): created successfully Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19940e84-64ad-4f69-8c9d-d0df374e18ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Flow 'volume_create_manager' (38279aaf-6b19-4fbc-ae9a-67a318fd749e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-564489d1-d35b-4e12-b1a1-36d7f7a003b1 tempest-VolumesListAdminTestJSON-632621251 None] Created volume successfully. Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Acquiring lock "cinder-quobyte-2e3daeae-2c13-4bc5-8f23-d578ae36e0db" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Lock "cinder-quobyte-2e3daeae-2c13-4bc5-8f23-d578ae36e0db" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:17 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[effc63c2-c414-4f92-ab82-4cf390b8fd51]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:17 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db Sep 28 12:19:17 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:17 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db" returned: 0 in 0.908s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:18 devstack sudo[96106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db Sep 28 12:19:18 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:18 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Flow 'volume_create_manager' (c567d0a9-179a-4df1-afc9-4c9102efdac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5f2eb6-4e07-4533-8269-36f6ab798882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2e3daeae-2c13-4bc5-8f23-d578ae36e0db" returned: 0 in 0.667s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5f2eb6-4e07-4533-8269-36f6ab798882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-29361913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e613b7-2163-4622-829f-10e071d7d723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb337fe772184ff4be91d4130492c712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:18Z,use_quota=True,user_id='7adf249086ee467b989c7dacae47724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1076d3de-c0e3-4d5e-965b-4fb11dc767b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1076d3de-c0e3-4d5e-965b-4fb11dc767b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcbb491-2165-4b89-b88f-54a40f567aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcbb491-2165-4b89-b88f-54a40f567aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0e613b7-2163-4622-829f-10e071d7d723', 'volume_name': 'volume-c0e613b7-2163-4622-829f-10e071d7d723', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861c7c24-2371-4456-8e09-5fa74426c06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861c7c24-2371-4456-8e09-5fa74426c06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def17c84-0b46-43ed-b074-ea57bee789a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Volume c0e613b7-2163-4622-829f-10e071d7d723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0e613b7-2163-4622-829f-10e071d7d723', 'volume_size': 1} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-29361913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0e613b7-2163-4622-829f-10e071d7d723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb337fe772184ff4be91d4130492c712',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:18Z,use_quota=True,user_id='7adf249086ee467b989c7dacae47724e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Creating volume c0e613b7-2163-4622-829f-10e071d7d723 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:18 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Lock "cinder-quobyte-2e3daeae-2c13-4bc5-8f23-d578ae36e0db" released by "delete_volume" :: held 1.799s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:18 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723 1073741824 Sep 28 12:19:18 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Flow 'volume_create_manager' (bf86ee10-c701-45ab-b133-c11d38c07710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1069a3-3961-4672-bbcc-d5dc2a64911f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d1069a3-3961-4672-bbcc-d5dc2a64911f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1990840468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c3e02a-e4e4-4891-ad40-1480a4e6e15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d082abf546d401a9cceca5e8aa28931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:19Z,use_quota=True,user_id='cbddb4e155a1436ab031179c0c36a24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503069c2-e5e1-405a-8351-b83b0fe39576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (503069c2-e5e1-405a-8351-b83b0fe39576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc255e01-1782-4a46-b048-fbf1f358a329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc255e01-1782-4a46-b048-fbf1f358a329) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69c3e02a-e4e4-4891-ad40-1480a4e6e15b', 'volume_name': 'volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc82634-b628-40a1-80d5-dbe054e4184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc82634-b628-40a1-80d5-dbe054e4184c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44031a1-8014-4c39-8d7e-73de4b8bef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Volume 69c3e02a-e4e4-4891-ad40-1480a4e6e15b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b', 'volume_size': 1} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:18 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Created reservations ['1ea2cb6a-d221-4768-9990-dd7b2b62d964'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Created reservations ['90c24899-8a8c-48ee-ab9d-abb6dd68f141', '64c05e19-66f4-4c0e-b435-893d82e25263', 'f3875fc9-557c-46a7-8786-fb863b0f1a91', 'b6fbb681-926f-4a78-ba9f-fec7b9972f8a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:19 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:19 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:19 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723 1073741824" returned: 0 in 0.809s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:19 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:19 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:19 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-14f9febf-8af9-49f1-8248-8874e2b1b57b tempest-GroupsV314Test-1528211538 None] Delete group completed successfully. Sep 28 12:19:19 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723 Sep 28 12:19:19 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:20 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723" returned: 0 in 0.519s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.179s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1990840468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69c3e02a-e4e4-4891-ad40-1480a4e6e15b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d082abf546d401a9cceca5e8aa28931',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:19Z,use_quota=True,user_id='cbddb4e155a1436ab031179c0c36a24f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Creating volume 69c3e02a-e4e4-4891-ad40-1480a4e6e15b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:20 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def17c84-0b46-43ed-b074-ea57bee789a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0e613b7-2163-4622-829f-10e071d7d723', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15500914-8f34-4506-ba2a-7655a5e61228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:20 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b 1073741824 Sep 28 12:19:20 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Volume volume-c0e613b7-2163-4622-829f-10e071d7d723 (c0e613b7-2163-4622-829f-10e071d7d723): created successfully Sep 28 12:19:20 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15500914-8f34-4506-ba2a-7655a5e61228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Flow 'volume_create_manager' (c567d0a9-179a-4df1-afc9-4c9102efdac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:20 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3dcc80e9-fb72-4ee2-8f97-96d83a368fbf tempest-VolumesListAdminTestJSON-632621251 None] Created volume successfully. Sep 28 12:19:21 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b 1073741824" returned: 0 in 0.885s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:21 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b Sep 28 12:19:21 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:21 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b" returned: 0 in 0.660s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d44031a1-8014-4c39-8d7e-73de4b8bef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81838e7-ece8-46d0-9059-599044739e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:21 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Volume volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b (69c3e02a-e4e4-4891-ad40-1480a4e6e15b): created successfully Sep 28 12:19:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b81838e7-ece8-46d0-9059-599044739e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Flow 'volume_create_manager' (bf86ee10-c701-45ab-b133-c11d38c07710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2cc6b011-76ea-4be8-8858-6346a4947bd1 tempest-ServersNegativeTestJSON-969943825 None] Created volume successfully. Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Flow 'volume_create_manager' (311902be-e12a-4cae-8756-905fa3f2b2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158fe92a-55d9-48c7-9d3f-db0c20445a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (158fe92a-55d9-48c7-9d3f-db0c20445a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74196f99092b4e78aa9e89b9ae5e3f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:22Z,use_quota=True,user_id='5781a7f06be549d9bf0eec0db8eb6563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a532e6-630d-473e-9f79-e6dfd0e0736a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a532e6-630d-473e-9f79-e6dfd0e0736a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e836e4de-7653-40ce-8c6e-76886d1b2eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e836e4de-7653-40ce-8c6e-76886d1b2eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3', 'volume_name': 'volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c32c04-ce3b-429f-8e4a-ed96992ac532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79c32c04-ce3b-429f-8e4a-ed96992ac532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee117da2-f6ff-48ae-b0de-2a00eb5d5b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:22 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Volume 7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3', 'volume_size': 1} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74196f99092b4e78aa9e89b9ae5e3f7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:22Z,use_quota=True,user_id='5781a7f06be549d9bf0eec0db8eb6563',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Creating volume 7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:22 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:19:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:22 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 1073741824 Sep 28 12:19:22 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:23 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 1073741824" returned: 0 in 0.941s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:23 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 Sep 28 12:19:23 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:24 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3" returned: 0 in 0.481s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee117da2-f6ff-48ae-b0de-2a00eb5d5b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818d5296-d389-4e4c-a602-5317f8b37317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:24 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Volume volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 (7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3): created successfully Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (818d5296-d389-4e4c-a602-5317f8b37317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Flow 'volume_create_manager' (311902be-e12a-4cae-8756-905fa3f2b2e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:24 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3f1c02fa-d79f-4ebe-8ba2-dec6f3cb459c tempest-VolumesListAdminTestJSON-200926560 None] Created volume successfully. Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Acquiring lock "cinder-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Lock "cinder-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "cinder-69c3e02a-e4e4-4891-ad40-1480a4e6e15b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Acquiring lock "cinder-quobyte-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Lock "cinder-69c3e02a-e4e4-4891-ad40-1480a4e6e15b-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Lock "cinder-quobyte-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3" acquired by "delete_volume" :: waited 0.083s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "cinder-c0e613b7-2163-4622-829f-10e071d7d723-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "cinder-quobyte-69c3e02a-e4e4-4891-ad40-1480a4e6e15b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-c0e613b7-2163-4622-829f-10e071d7d723-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1cb3be-5a37-4bc9-a396-7b8cbd99ba92]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Lock "cinder-quobyte-69c3e02a-e4e4-4891-ad40-1480a4e6e15b" acquired by "delete_volume" :: waited 0.057s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[523c35e3-c322-4eed-8471-b255537a6d83]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "cinder-quobyte-c0e613b7-2163-4622-829f-10e071d7d723" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-quobyte-c0e613b7-2163-4622-829f-10e071d7d723" acquired by "delete_volume" :: waited 0.033s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:25 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 Sep 28 12:19:25 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[19feba90-4a53-4bb2-9737-6602ec468741]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:25 devstack sudo[96148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723 Sep 28 12:19:25 devstack sudo[96148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:25 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b Sep 28 12:19:25 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:25 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3" returned: 0 in 0.775s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:25 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3 Sep 28 12:19:25 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:26 devstack sudo[96148]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:26 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723" returned: 0 in 0.803s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b" returned: 0 in 0.982s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:26 devstack sudo[96163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723 Sep 28 12:19:26 devstack sudo[96163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:26 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b Sep 28 12:19:26 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:26 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3" returned: 0 in 0.603s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Lock "cinder-quobyte-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3" released by "delete_volume" :: held 1.535s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:26 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-69c3e02a-e4e4-4891-ad40-1480a4e6e15b" returned: 0 in 0.611s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Lock "cinder-quobyte-69c3e02a-e4e4-4891-ad40-1480a4e6e15b" released by "delete_volume" :: held 1.694s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Created reservations ['e0d51650-2b9a-49df-b6ab-cf39dc476072', '83805bc1-b0c0-4e35-9b15-26e0bfab0b00', '6559bb7e-f91b-4b81-aab2-f173c87ab5fb', '4cde6b69-3a81-4cab-9a54-264100380ab1'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:26 devstack sudo[96163]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c0e613b7-2163-4622-829f-10e071d7d723" returned: 0 in 0.709s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-quobyte-c0e613b7-2163-4622-829f-10e071d7d723" released by "delete_volume" :: held 1.622s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:26 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Created reservations ['65811f24-4a6a-4ece-a1fa-3c3c7821f0c5', '2beb6709-6f46-4ac7-8010-94ca828d7ba7', '01f7ddf0-ab4f-45f4-aa87-072942811900', '002e0494-7a1b-4054-86ae-95761f2353eb'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Created reservations ['c5fa3d4b-cd57-4319-8428-f16feb202e4f', '292e7446-eda6-4482-92b5-49c208369bf1', 'ac7fc6b3-52b7-430e-a916-933824ad466f', 'b53f6c3f-4c72-41e6-9c42-44291bbf7f84'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:27 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:27 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:27 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:27 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "cinder-d693a41d-8133-4aa7-91b3-4e683c092c31-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:27 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.520s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Lock "cinder-d693a41d-8133-4aa7-91b3-4e683c092c31-delete_volume" acquired by "delete_volume" :: waited 0.160s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Deleted volume successfully. Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-31cedce3-09d4-4520-bd60-636468cc19ba tempest-VolumesListAdminTestJSON-200926560 None] Lock "cinder-7f99d8b8-9c52-4002-83a0-8f0d6b3a4ad3-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:27 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.512s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:27 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:27 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Deleted volume successfully. Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "cinder-4275748f-d049-4176-87b3-a5619c968538-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "cinder-quobyte-d693a41d-8133-4aa7-91b3-4e683c092c31" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c7977bc-aa18-490a-8651-09c2c12c3372 tempest-ServersNegativeTestJSON-969943825 None] Lock "cinder-69c3e02a-e4e4-4891-ad40-1480a4e6e15b-delete_volume" released by "delete_volume" :: held 3.052s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-4275748f-d049-4176-87b3-a5619c968538-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Lock "cinder-quobyte-d693a41d-8133-4aa7-91b3-4e683c092c31" acquired by "delete_volume" :: waited 0.090s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41d6989-da69-42aa-961c-efa863c61707]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "cinder-quobyte-4275748f-d049-4176-87b3-a5619c968538" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-quobyte-4275748f-d049-4176-87b3-a5619c968538" acquired by "delete_volume" :: waited 0.047s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9bdff8-ecb7-41e0-a164-48e12d229e03]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:28 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.622s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Deleted volume successfully. Sep 28 12:19:28 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31 Sep 28 12:19:28 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6d87ef1c-a11e-47d7-a81d-b88f85e4fc92 tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-c0e613b7-2163-4622-829f-10e071d7d723-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:28 devstack sudo[96180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538 Sep 28 12:19:28 devstack sudo[96180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:28 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31" returned: 0 in 0.763s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:28 devstack sudo[96180]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:28 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31 Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538" returned: 0 in 0.608s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:28 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:28 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538 Sep 28 12:19:28 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:29 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d693a41d-8133-4aa7-91b3-4e683c092c31" returned: 0 in 0.698s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Lock "cinder-quobyte-d693a41d-8133-4aa7-91b3-4e683c092c31" released by "delete_volume" :: held 1.561s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:29 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4275748f-d049-4176-87b3-a5619c968538" returned: 0 in 0.700s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-quobyte-4275748f-d049-4176-87b3-a5619c968538" released by "delete_volume" :: held 1.411s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Created reservations ['255348b3-76b2-4feb-8c06-a01eafc1a235', 'c1e8703b-45f3-4c1b-8b58-5a04f2ddc09e', 'ae3abc37-e6ac-46c7-8f9a-579e9bc1d45a', '58bb083b-c0b4-4b89-9755-66e26e78e63b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Created reservations ['379468c4-ca90-44db-a303-2c0b68811bb2', 'ca168fac-6520-40d8-ba21-0f6e08231812', '563ed508-71c4-456f-ab9d-4b74ef09a367', '1559410b-62cb-4ea3-a9a7-669618a99435'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:29 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:29 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:30 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:30 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:30 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.652s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:30 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:30 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Deleted volume successfully. Sep 28 12:19:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d7bf2cd4-397b-454e-ba20-b457ffd6d2bc tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-4275748f-d049-4176-87b3-a5619c968538-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "cinder-20e3e3c8-e322-4a51-81c7-59c753285736-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-20e3e3c8-e322-4a51-81c7-59c753285736-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "cinder-quobyte-20e3e3c8-e322-4a51-81c7-59c753285736" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-quobyte-20e3e3c8-e322-4a51-81c7-59c753285736" acquired by "delete_volume" :: waited 0.040s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:31 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 1.183s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:31 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8c9127-b356-420a-b73d-dae96d1317f5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:31 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Deleted volume successfully. Sep 28 12:19:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ecc5d344-33e8-4d41-bfe4-bb0451ba5653 tempest-ServersNegativeTestJSON-969943825 None] Lock "cinder-d693a41d-8133-4aa7-91b3-4e683c092c31-delete_volume" released by "delete_volume" :: held 3.733s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:31 devstack sudo[96206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736 Sep 28 12:19:31 devstack sudo[96206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:32 devstack sudo[96206]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736" returned: 0 in 1.248s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:32 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736 Sep 28 12:19:32 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:33 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20e3e3c8-e322-4a51-81c7-59c753285736" returned: 0 in 0.711s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-quobyte-20e3e3c8-e322-4a51-81c7-59c753285736" released by "delete_volume" :: held 2.114s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:33 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Created reservations ['d83a0782-7c20-400e-98f4-60af08ce1cb3', 'ecc18f76-5769-4c3a-9498-fe6e5b3a2df9', '34d6964d-16f5-45d7-bafe-5950725ac0ed', '34478993-a8d4-4fef-9b82-31ab49379bc0'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:33 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:33 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:34 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.518s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:34 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Deleted volume successfully. Sep 28 12:19:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0b2bbf80-f2e6-40a8-b81b-4afeaa8c248c tempest-VolumesListAdminTestJSON-632621251 None] Lock "cinder-20e3e3c8-e322-4a51-81c7-59c753285736-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:38 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:38 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:38 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.344s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:19:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:19:43 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=87,cinder:SELECT=44,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:19:44 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=68,cinder:UPDATE=81,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:19:47 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Flow 'volume_create_manager' (876903ea-73af-40d6-ab45-7c544169af15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced0cc74-74d3-40cc-9ce4-4886f7403592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ced0cc74-74d3-40cc-9ce4-4886f7403592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1866458319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ab4c0b-3d2d-4eb1-8450-873996ed0eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2201ba5d5e4e5997e00c25a3d13593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:48Z,use_quota=True,user_id='4a98fcb247244846b1df73577a9834f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acb6c65-2be2-4eef-8865-4661fc22c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acb6c65-2be2-4eef-8865-4661fc22c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94a89f7-3786-4774-9674-ccd48a241b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:47 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:19:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94a89f7-3786-4774-9674-ccd48a241b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85ab4c0b-3d2d-4eb1-8450-873996ed0eaf', 'volume_name': 'volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70db155b-91ca-4908-adc7-6b10270ab1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70db155b-91ca-4908-adc7-6b10270ab1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f018fcf-5fa9-46e3-b490-4d3611e9fc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:48 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Volume 85ab4c0b-3d2d-4eb1-8450-873996ed0eaf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:19:48 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Trying to clone 85ab4c0b-3d2d-4eb1-8450-873996ed0eaf from image d446342e-1c65-4f57-97fb-ae62bc9167ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:19:48 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:19:48 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:19:48 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3787e760-0cd0-4e57-83e8-c5d180568fd2]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:49 devstack sudo[96303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD Sep 28 12:19:49 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Flow 'volume_create_manager' (80ae3c13-6223-44ee-b924-d5479ed57430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdbd0e2-451e-4814-996d-c977dbf3d915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efdbd0e2-451e-4814-996d-c977dbf3d915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-48237136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442bb10f-21a7-4190-89ac-691ecb6c88e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2423fc1ea694847bbc4d7b0c5cab020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:49Z,use_quota=True,user_id='878a4810959c4962a1c302232c40384f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a751a-6457-494a-b1da-79b15d4113c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a95a751a-6457-494a-b1da-79b15d4113c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc83db7-84a5-4795-a5b5-e04193ca7dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dc83db7-84a5-4795-a5b5-e04193ca7dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '442bb10f-21a7-4190-89ac-691ecb6c88e5', 'volume_name': 'volume-442bb10f-21a7-4190-89ac-691ecb6c88e5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3197f890-ab47-47b2-9016-c55490c6b9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3197f890-ab47-47b2-9016-c55490c6b9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa88c1e3-ed51-481a-ba07-b22d29e3c433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:49 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Volume 442bb10f-21a7-4190-89ac-691ecb6c88e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-442bb10f-21a7-4190-89ac-691ecb6c88e5', 'volume_size': 1} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-48237136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=442bb10f-21a7-4190-89ac-691ecb6c88e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2423fc1ea694847bbc4d7b0c5cab020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:49Z,use_quota=True,user_id='878a4810959c4962a1c302232c40384f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Creating volume 442bb10f-21a7-4190-89ac-691ecb6c88e5 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:49 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:49 devstack sudo[96312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 1073741824 Sep 28 12:19:49 devstack sudo[96312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:49 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef is fetched for user 4a98fcb247244846b1df73577a9834f6. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ea853e-9842-4e55-92c5-627374284f5e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-1ae3a762-fb0f-4500-8417-0f14f2b7ef57 req-eb36c365-022d-4b1e-8090-1debc83074d4 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:49 devstack sudo[96319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD Sep 28 12:19:49 devstack sudo[96319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:49 devstack sudo[96312]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 1073741824" returned: 0 in 0.532s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:50 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 Sep 28 12:19:50 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:50 devstack sudo[96319]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:50 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5" returned: 0 in 0.280s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-1ae3a762-fb0f-4500-8417-0f14f2b7ef57 req-eb36c365-022d-4b1e-8090-1debc83074d4 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.597s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa88c1e3-ed51-481a-ba07-b22d29e3c433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-442bb10f-21a7-4190-89ac-691ecb6c88e5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa670214-058a-4d6c-8e25-c7800544e349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-1ae3a762-fb0f-4500-8417-0f14f2b7ef57 req-eb36c365-022d-4b1e-8090-1debc83074d4 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1866458319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85ab4c0b-3d2d-4eb1-8450-873996ed0eaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c2201ba5d5e4e5997e00c25a3d13593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:48Z,use_quota=True,user_id='4a98fcb247244846b1df73577a9834f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Creating volume 85ab4c0b-3d2d-4eb1-8450-873996ed0eaf {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:50 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:50 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Volume volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 (442bb10f-21a7-4190-89ac-691ecb6c88e5): created successfully Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa670214-058a-4d6c-8e25-c7800544e349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Flow 'volume_create_manager' (80ae3c13-6223-44ee-b924-d5479ed57430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:50 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf 1073741824 Sep 28 12:19:50 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-1ae3a762-fb0f-4500-8417-0f14f2b7ef57 req-eb36c365-022d-4b1e-8090-1debc83074d4 tempest-TestInstancesWithCinderVolumes-1545191425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e5ee72a-9bfc-448d-bdf3-fbe14a21eb92', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:19:50 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-73886213-4a09-44fd-862e-acd873c87e3a tempest-VolumeQuotasAdminTestJSON-136582597 None] Created volume successfully. Sep 28 12:19:50 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-1ae3a762-fb0f-4500-8417-0f14f2b7ef57 req-eb36c365-022d-4b1e-8090-1debc83074d4 tempest-TestInstancesWithCinderVolumes-1545191425 None] attachment_update completed successfully. Sep 28 12:19:50 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf 1073741824" returned: 0 in 0.604s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:51 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf Sep 28 12:19:51 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:51 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf" returned: 0 in 0.388s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Attempting download of d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume 85ab4c0b-3d2d-4eb1-8450-873996ed0eaf. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09b6d8f-6ea6-41df-af74-b86fb57c564e]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_xoect3cg {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Acquiring lock "cinder-442bb10f-21a7-4190-89ac-691ecb6c88e5-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "cinder-442bb10f-21a7-4190-89ac-691ecb6c88e5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Acquiring lock "cinder-quobyte-442bb10f-21a7-4190-89ac-691ecb6c88e5" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "cinder-quobyte-442bb10f-21a7-4190-89ac-691ecb6c88e5" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcd345d-7c18-478f-b32e-7563c35a8103]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:51 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_xoect3cg Sep 28 12:19:51 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:51 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 Sep 28 12:19:51 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:52 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_xoect3cg" returned: 0 in 0.623s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_xoect3cg {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:52 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_xoect3cg Sep 28 12:19:52 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:52 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5" returned: 0 in 0.682s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:52 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5 Sep 28 12:19:52 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:52 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_xoect3cg" returned: 1 in 0.488s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_xoect3cg' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[044cdd04-3bbd-45d6-8790-efda41943f5b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:52 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-442bb10f-21a7-4190-89ac-691ecb6c88e5" returned: 0 in 0.378s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "cinder-quobyte-442bb10f-21a7-4190-89ac-691ecb6c88e5" released by "delete_volume" :: held 1.144s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:52 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD Sep 28 12:19:52 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Created reservations ['47556576-f076-4b95-a5b3-59b77dd11e87', '613ae7f9-9483-47eb-8928-c9f54bc901ac', 'd80dfb52-5ef8-489d-95cd-99ac6c14333b', 'af58aa05-f285-4f16-a723-b9056c66db52'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:53 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:53 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:53 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] d446342e-1c65-4f57-97fb-ae62bc9167ef was qcow2, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:53 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf Sep 28 12:19:53 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-31fd3eec-2db0-48a4-b1e1-5a88250e753a req-c8092163-0bd3-44a4-bb1d-ab183e08ce47 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-31fd3eec-2db0-48a4-b1e1-5a88250e753a req-c8092163-0bd3-44a4-bb1d-ab183e08ce47 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-31fd3eec-2db0-48a4-b1e1-5a88250e753a req-c8092163-0bd3-44a4-bb1d-ab183e08ce47 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-31fd3eec-2db0-48a4-b1e1-5a88250e753a req-c8092163-0bd3-44a4-bb1d-ab183e08ce47 tempest-TestInstancesWithCinderVolumes-1545191425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4d4d4cac-6970-4627-abea-2c7ea311b5b3', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:19:53 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.346s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Deleted volume successfully. Sep 28 12:19:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f975a53d-3ee9-492b-90cd-bd21d331a011 tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "cinder-442bb10f-21a7-4190-89ac-691ecb6c88e5-delete_volume" released by "delete_volume" :: held 1.889s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-31fd3eec-2db0-48a4-b1e1-5a88250e753a req-c8092163-0bd3-44a4-bb1d-ab183e08ce47 tempest-TestInstancesWithCinderVolumes-1545191425 None] attachment_update completed successfully. Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Flow 'volume_create_manager' (b2325e9b-d3ab-4dfe-a955-752f1eadb029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5661092-b80a-4a5d-b3e2-a49aab1c0c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5661092-b80a-4a5d-b3e2-a49aab1c0c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-893217822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636d20e9-b5a8-4699-b324-f5be4c73cd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2423fc1ea694847bbc4d7b0c5cab020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:55Z,use_quota=True,user_id='878a4810959c4962a1c302232c40384f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55d158e-5574-4c35-ab1f-cb200d7dfbd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a55d158e-5574-4c35-ab1f-cb200d7dfbd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa540d7-a290-4873-86ac-2be44f2d6d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa540d7-a290-4873-86ac-2be44f2d6d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636d20e9-b5a8-4699-b324-f5be4c73cd9f', 'volume_name': 'volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4b6ec2-eee2-4145-bcd0-790983d6a263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4b6ec2-eee2-4145-bcd0-790983d6a263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0bfb16-295f-43d9-bf8a-b381b3da1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:54 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Volume 636d20e9-b5a8-4699-b324-f5be4c73cd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f', 'volume_size': 1} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:19:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-893217822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636d20e9-b5a8-4699-b324-f5be4c73cd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2423fc1ea694847bbc4d7b0c5cab020',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:19:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:19:55Z,use_quota=True,user_id='878a4810959c4962a1c302232c40384f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Creating volume 636d20e9-b5a8-4699-b324-f5be4c73cd9f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:19:54 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:19:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:54 devstack sudo[96409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f 1073741824 Sep 28 12:19:54 devstack sudo[96409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:55 devstack sudo[96409]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f 1073741824" returned: 0 in 0.756s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:55 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f Sep 28 12:19:55 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:56 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf" returned: 0 in 3.014s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_6_kyo2didevstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:19:56 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Converted 112.00 MB image at 37.12 MB/s Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:56 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf 1G Sep 28 12:19:56 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:56 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f" returned: 0 in 0.639s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0bfb16-295f-43d9-bf8a-b381b3da1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce67d4da-ea47-4ff1-97f4-c45da8cd9d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:56 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Volume volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f (636d20e9-b5a8-4699-b324-f5be4c73cd9f): created successfully Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce67d4da-ea47-4ff1-97f4-c45da8cd9d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Flow 'volume_create_manager' (b2325e9b-d3ab-4dfe-a955-752f1eadb029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:56 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3de3be8e-91e4-4704-816d-746f4ffad50f tempest-VolumeQuotasAdminTestJSON-136582597 None] Created volume successfully. Sep 28 12:19:56 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf 1G" returned: 0 in 0.553s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Downloaded image d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume 85ab4c0b-3d2d-4eb1-8450-873996ed0eaf successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef for user 4a98fcb247244846b1df73577a9834f6 is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Marking volume 85ab4c0b-3d2d-4eb1-8450-873996ed0eaf as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Copying metadata from image d446342e-1c65-4f57-97fb-ae62bc9167ef to 85ab4c0b-3d2d-4eb1-8450-873996ed0eaf. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Creating volume glance metadata for volume 85ab4c0b-3d2d-4eb1-8450-873996ed0eaf backed by image d446342e-1c65-4f57-97fb-ae62bc9167ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f018fcf-5fa9-46e3-b490-4d3611e9fc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ac1af4-df96-4ee3-bd49-cf2100282fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:19:56 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Volume volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf (85ab4c0b-3d2d-4eb1-8450-873996ed0eaf): created successfully Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ac1af4-df96-4ee3-bd49-cf2100282fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:19:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Flow 'volume_create_manager' (876903ea-73af-40d6-ab45-7c544169af15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:19:56 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7929ab66-c6be-4f2a-8695-460e74225282 tempest-VolumesImageMetadata-1725243322 None] Created volume successfully. Sep 28 12:19:57 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4fdae81b-a0f3-4459-b87c-3279ad91fd60 tempest-VolumeQuotasAdminTestJSON-1733550548 None] Transfer volume completed successfully. Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Acquiring lock "cinder-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Lock "cinder-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Acquiring lock "cinder-quobyte-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Lock "cinder-quobyte-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf" acquired by "delete_volume" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[788d276a-7342-4602-8645-d45cf0c01f66]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:58 devstack sudo[96469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf Sep 28 12:19:58 devstack sudo[96469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Acquiring lock "cinder-636d20e9-b5a8-4699-b324-f5be4c73cd9f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Lock "cinder-636d20e9-b5a8-4699-b324-f5be4c73cd9f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Acquiring lock "cinder-quobyte-636d20e9-b5a8-4699-b324-f5be4c73cd9f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Lock "cinder-quobyte-636d20e9-b5a8-4699-b324-f5be4c73cd9f" acquired by "delete_volume" :: waited 0.041s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dfe563-e660-4318-af11-62e15bb437a0]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:58 devstack sudo[96469]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf" returned: 0 in 0.570s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:59 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f Sep 28 12:19:59 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:59 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf Sep 28 12:19:59 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:59 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf" returned: 0 in 0.356s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Lock "cinder-quobyte-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf" released by "delete_volume" :: held 1.000s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:59 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f" returned: 0 in 0.559s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:59 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f Sep 28 12:19:59 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Created reservations ['4d5ad9c6-b353-4507-b199-7919edd767c7', 'c612812a-166b-44fd-906f-6b9b86c15fea', '765a6bd2-8d81-4cc8-aa44-8097f0bb7e23', '9edee83a-3af0-4456-82c2-25c73dbcc797'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:19:59 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:19:59 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:19:59 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-636d20e9-b5a8-4699-b324-f5be4c73cd9f" returned: 0 in 0.351s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Lock "cinder-quobyte-636d20e9-b5a8-4699-b324-f5be4c73cd9f" released by "delete_volume" :: held 0.974s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Created reservations ['6a2dea7a-7279-42f6-a41f-90687822b580', 'cebe8182-d4f7-4a4c-89ce-c25f77bd0416', '453b1e63-9157-4528-b6dc-239a38dae26c', 'df8caaae-a002-4208-9eae-16ca5c96bc56'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:19:59 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.349s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:19:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Deleted volume successfully. Sep 28 12:19:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-465962dd-fc0a-4282-acb5-c48866036ba9 tempest-VolumesImageMetadata-1725243322 None] Lock "cinder-85ab4c0b-3d2d-4eb1-8450-873996ed0eaf-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:00 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:00 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:00 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.373s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:00 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:00 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Deleted volume successfully. Sep 28 12:20:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-42163c52-b9f5-4746-8538-21c3f990a6fd tempest-VolumeQuotasAdminTestJSON-433029864 None] Lock "cinder-636d20e9-b5a8-4699-b324-f5be4c73cd9f-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-c2149cd8-5c41-47ac-9412-dbb99e82dcb5 req-fd5d4038-b459-4a45-b99c-65d9ad77d226 tempest-TestInstancesWithCinderVolumes-1545191425 None] Terminate volume connection completed successfully. Sep 28 12:20:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-c2149cd8-5c41-47ac-9412-dbb99e82dcb5 req-fd5d4038-b459-4a45-b99c-65d9ad77d226 tempest-TestInstancesWithCinderVolumes-1545191425 None] Deleting attachment 2e5ee72a-9bfc-448d-bdf3-fbe14a21eb92. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:20:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "cinder-82acde7f-1e30-49cd-a5a8-6176e606f4c3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-82acde7f-1e30-49cd-a5a8-6176e606f4c3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "cinder-quobyte-82acde7f-1e30-49cd-a5a8-6176e606f4c3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-quobyte-82acde7f-1e30-49cd-a5a8-6176e606f4c3" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:02 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[231129c6-5379-4dee-bd77-388eeffeab93]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:02 devstack sudo[96528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 Sep 28 12:20:02 devstack sudo[96528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:02 devstack sudo[96528]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3" returned: 0 in 0.737s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:02 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3 Sep 28 12:20:02 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:03 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-82acde7f-1e30-49cd-a5a8-6176e606f4c3" returned: 0 in 0.425s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-quobyte-82acde7f-1e30-49cd-a5a8-6176e606f4c3" released by "delete_volume" :: held 1.250s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:03 devstack cinder-volume[87048]: WARNING cinder.quota [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-695724266-850277575 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-695724266-850277575, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:20:03 devstack cinder-volume[87048]: WARNING cinder.quota [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-695724266-850277575 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-695724266-850277575, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Created reservations ['1b4ef209-c3a9-4d85-b01b-3fb8a1394cc3', 'df9db247-f7d0-484d-9a73-34df929a6732', '25695f2b-ad8e-4eb7-86b7-d449d22000f6', '61b60afb-d6ba-417e-98f7-ca34495d61c8'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:03 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:03 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:03 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.415s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:03 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Deleted volume successfully. Sep 28 12:20:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4c858e5a-12cc-4aa4-a230-1f6129d82871 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-82acde7f-1e30-49cd-a5a8-6176e606f4c3-delete_volume" released by "delete_volume" :: held 2.069s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Flow 'volume_create_manager' (6b000772-0133-4d1d-94d8-7e7b0414da04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589713bc-e030-4590-b452-e2eef9e9a3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (589713bc-e030-4590-b452-e2eef9e9a3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-603615949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1401a2f-c011-4810-bf4d-1ce431c51f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd5d1d613374861801b02d55ad83e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:07Z,use_quota=True,user_id='6a40d0dc7aaa47ec804e0f6bb3fc1bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614eacee-2d16-40ea-baba-e8951ae75d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614eacee-2d16-40ea-baba-e8951ae75d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005ae6e9-e669-4da0-8b9b-a860993d5b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (005ae6e9-e669-4da0-8b9b-a860993d5b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1401a2f-c011-4810-bf4d-1ce431c51f22', 'volume_name': 'volume-b1401a2f-c011-4810-bf4d-1ce431c51f22', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb61b46-862d-4508-b406-23b7fcd54bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb61b46-862d-4508-b406-23b7fcd54bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c36636b-1813-46a9-90ae-81215f3fe3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:06 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Volume b1401a2f-c011-4810-bf4d-1ce431c51f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1401a2f-c011-4810-bf4d-1ce431c51f22', 'volume_size': 1} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-603615949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1401a2f-c011-4810-bf4d-1ce431c51f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd5d1d613374861801b02d55ad83e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:07Z,use_quota=True,user_id='6a40d0dc7aaa47ec804e0f6bb3fc1bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Creating volume b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:06 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:20:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:06 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 1073741824 Sep 28 12:20:06 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:07 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 1073741824" returned: 0 in 0.680s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:07 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-623282c3-0b8a-4908-bcf4-bfab2d27e7da req-b423611d-389d-4b9b-8f19-3319a9ac448b tempest-TestInstancesWithCinderVolumes-1545191425 None] Terminate volume connection completed successfully. Sep 28 12:20:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-623282c3-0b8a-4908-bcf4-bfab2d27e7da req-b423611d-389d-4b9b-8f19-3319a9ac448b tempest-TestInstancesWithCinderVolumes-1545191425 None] Deleting attachment 4d4d4cac-6970-4627-abea-2c7ea311b5b3. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:20:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:07 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 Sep 28 12:20:07 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:07 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22" returned: 0 in 0.352s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c36636b-1813-46a9-90ae-81215f3fe3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1401a2f-c011-4810-bf4d-1ce431c51f22', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9211c68-897a-4d73-8a56-2394a446354e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "cinder-123c6f9a-e4e8-4549-84b7-79dc15339b8f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:07 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Volume volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 (b1401a2f-c011-4810-bf4d-1ce431c51f22): created successfully Sep 28 12:20:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9211c68-897a-4d73-8a56-2394a446354e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Flow 'volume_create_manager' (6b000772-0133-4d1d-94d8-7e7b0414da04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-123c6f9a-e4e8-4549-84b7-79dc15339b8f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:08 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ea1d83f9-dcc2-480a-bcfe-d5536a524246 tempest-VolumesCloneTest-569139357 None] Created volume successfully. Sep 28 12:20:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "cinder-quobyte-123c6f9a-e4e8-4549-84b7-79dc15339b8f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-quobyte-123c6f9a-e4e8-4549-84b7-79dc15339b8f" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:08 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[05179752-6291-4487-92ec-8bff9a5f68b4]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:08 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f Sep 28 12:20:08 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:08 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f" returned: 0 in 0.533s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:08 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f Sep 28 12:20:08 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:09 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-123c6f9a-e4e8-4549-84b7-79dc15339b8f" returned: 0 in 0.461s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-quobyte-123c6f9a-e4e8-4549-84b7-79dc15339b8f" released by "delete_volume" :: held 1.074s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:09 devstack cinder-volume[87048]: WARNING cinder.quota [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1440253657-1864471217 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1440253657-1864471217, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:20:09 devstack cinder-volume[87048]: WARNING cinder.quota [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1440253657-1864471217 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1440253657-1864471217, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Created reservations ['d4deb7d3-c47b-4ce0-8277-e08a87d2e0b7', '19d1eab1-cc9b-4c56-9703-392853e9795d', '717a8b56-02f0-43b2-b599-0a896cfe1dda', '4262c351-7224-4281-8070-6f76443b863f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:09 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:09 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:09 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.406s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:09 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Deleted volume successfully. Sep 28 12:20:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3c98335e-ab33-44ce-9179-0e25a3c79879 tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-123c6f9a-e4e8-4549-84b7-79dc15339b8f-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Flow 'volume_create_manager' (91ff60d4-ec8f-40b3-840f-78e4ed6b5080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be48072-615a-4a0d-982f-2a661f35e300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be48072-615a-4a0d-982f-2a661f35e300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-224431986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae89223e-fa58-4ebd-879b-6fa5e337df4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcd5d1d613374861801b02d55ad83e7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b1401a2f-c011-4810-bf4d-1ce431c51f22,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:10Z,use_quota=True,user_id='6a40d0dc7aaa47ec804e0f6bb3fc1bc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50ce22f-b7ea-4674-8fcc-bf6a7b07237e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a50ce22f-b7ea-4674-8fcc-bf6a7b07237e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b825ace0-0092-454d-85d8-addc97168aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b825ace0-0092-454d-85d8-addc97168aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ae89223e-fa58-4ebd-879b-6fa5e337df4b', 'volume_name': 'volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b', 'volume_size': 2, 'source_volid': 'b1401a2f-c011-4810-bf4d-1ce431c51f22', 'source_volstatus': 'available'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0c6cd5-8477-4c76-b144-d7343711982c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0c6cd5-8477-4c76-b144-d7343711982c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6fc323-14d4-4bda-b86c-0b01062c6f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:10 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Volume ae89223e-fa58-4ebd-879b-6fa5e337df4b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b', 'volume_size': 2, 'source_volid': 'b1401a2f-c011-4810-bf4d-1ce431c51f22', 'source_volstatus': 'available'} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:10 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Cloning volume b1401a2f-c011-4810-bf4d-1ce431c51f22 to volume ae89223e-fa58-4ebd-879b-6fa5e337df4b Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Creating offline snapshot 4eb57c25-f4bf-4bfb-859c-648c9cc1260d of volume b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b677a87a-872b-4791-acf8-0758dd4c87da]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:10 devstack sudo[96612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 Sep 28 12:20:10 devstack sudo[96612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:11 devstack sudo[96612]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22" returned: 0 in 0.684s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:11 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d 1G Sep 28 12:20:11 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:11 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d 1G" returned: 0 in 0.620s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:11 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d Sep 28 12:20:11 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:12 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d" returned: 0 in 0.550s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:12 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d is being set with open permissions: ugo+rw Sep 28 12:20:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:12 devstack sudo[96631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d Sep 28 12:20:12 devstack sudo[96631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:12 devstack sudo[96631]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d" returned: 0 in 0.462s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:12 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.info Sep 28 12:20:12 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:13 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.info" returned: 0 in 0.413s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:13 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.info is being set with open permissions: ugo+rw Sep 28 12:20:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:13 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.info Sep 28 12:20:13 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:13 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.info" returned: 0 in 0.605s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Acquiring lock "cinder-quobyte-ae89223e-fa58-4ebd-879b-6fa5e337df4b" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Lock "cinder-quobyte-ae89223e-fa58-4ebd-879b-6fa5e337df4b" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] snapshot: 4eb57c25-f4bf-4bfb-859c-648c9cc1260d, volume: ae89223e-fa58-4ebd-879b-6fa5e337df4b, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c065a2dc-a8bd-4cb7-b3a0-db92a631d853]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Flow 'volume_create_manager' (9466c9b0-02f3-4a69-94f5-c6ec82361462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4d3600-38f7-44ce-adf5-27d908dbafe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4d3600-38f7-44ce-adf5-27d908dbafe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1992832144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9fb077-3c76-4420-bfde-9bb86648de54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef380b527034e1aab74b1a2c2c24857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:14Z,use_quota=True,user_id='7d7196d943e74bbaa4fb8ecf1858e010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9026de91-6231-4a81-b1fc-2bb579633d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9026de91-6231-4a81-b1fc-2bb579633d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d7d97e-4289-4c7a-9452-78923475300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:14 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d Sep 28 12:20:14 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d7d97e-4289-4c7a-9452-78923475300f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c9fb077-3c76-4420-bfde-9bb86648de54', 'volume_name': 'volume-3c9fb077-3c76-4420-bfde-9bb86648de54', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf27c3f8-1ee1-4fdb-b660-a6aaef203d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf27c3f8-1ee1-4fdb-b660-a6aaef203d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401d97cd-9d9b-4e56-a9ba-7d5d4da9990d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:14 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Volume 3c9fb077-3c76-4420-bfde-9bb86648de54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c9fb077-3c76-4420-bfde-9bb86648de54', 'volume_size': 1} Sep 28 12:20:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:14 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d" returned: 0 in 0.958s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1401a2f-c011-4810-bf4d-1ce431c51f22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:15 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed90e0d-5c52-4ab6-bebc-6b5ae72b3310]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:15 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 Sep 28 12:20:15 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:15 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22" returned: 0 in 0.693s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:20:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:20:15 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:20:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:15 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b Sep 28 12:20:15 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-1d3f0123-9569-49ca-92f9-5a5f1148a28a req-2e0297c7-e211-443c-9219-05d52d60612c tempest-TestInstancesWithCinderVolumes-1545191425 None] Terminate volume connection completed successfully. Sep 28 12:20:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-1d3f0123-9569-49ca-92f9-5a5f1148a28a req-2e0297c7-e211-443c-9219-05d52d60612c tempest-TestInstancesWithCinderVolumes-1545191425 None] Deleting attachment 0f728b5e-deb6-4579-8233-30d7a50ca54c. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:20:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "cinder-9c97ecd7-8366-4112-8fe4-75f8fa64b775-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-9c97ecd7-8366-4112-8fe4-75f8fa64b775-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "cinder-quobyte-9c97ecd7-8366-4112-8fe4-75f8fa64b775" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-quobyte-9c97ecd7-8366-4112-8fe4-75f8fa64b775" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:18 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae541b6-1bf1-4ef5-89ea-86e3bdf5241d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:18 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 Sep 28 12:20:19 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:19 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775" returned: 0 in 1.008s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:19 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775 Sep 28 12:20:19 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:20 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9c97ecd7-8366-4112-8fe4-75f8fa64b775" returned: 0 in 0.681s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-quobyte-9c97ecd7-8366-4112-8fe4-75f8fa64b775" released by "delete_volume" :: held 1.812s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:20 devstack cinder-volume[87048]: WARNING cinder.quota [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1701899424-637733812 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1701899424-637733812, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:20:20 devstack cinder-volume[87048]: WARNING cinder.quota [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1701899424-637733812 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1701899424-637733812, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:20:20 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Created reservations ['dfa7569c-f10b-4778-b395-aa1e3c469df5', '79a9bb72-5f6e-471f-850c-0e6b5fdceb96', '76d21f13-9843-45cc-8dda-2f9ea6f3dd3a', '9d8ce310-545e-4387-938c-e33a6accd341'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:20 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:20 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:21 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.919s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:21 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:21 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Deleted volume successfully. Sep 28 12:20:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-fdd5f176-31fc-4dd3-b1e1-ffc76364a0da tempest-TestInstancesWithCinderVolumes-1545191425 None] Lock "cinder-9c97ecd7-8366-4112-8fe4-75f8fa64b775-delete_volume" released by "delete_volume" :: held 3.353s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:25 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b" returned: 0 in 9.591s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22, size 1024.00 MB, duration 9.59 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:20:25 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Converted 1024.00 MB image at 106.76 MB/s Sep 28 12:20:25 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b is being set with open permissions: ugo+rw Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:25 devstack sudo[96790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b Sep 28 12:20:25 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:25 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b" returned: 0 in 0.247s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Lock "cinder-quobyte-ae89223e-fa58-4ebd-879b-6fa5e337df4b" released by "_copy_volume_from_snapshot" :: held 11.664s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Acquiring lock "cinder-quobyte-4eb57c25-f4bf-4bfb-859c-648c9cc1260d" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Lock "cinder-quobyte-4eb57c25-f4bf-4bfb-859c-648c9cc1260d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Deleting offline snapshot 4eb57c25-f4bf-4bfb-859c-648c9cc1260d of volume b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] snapshot_file for this snap is: volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4942737c-668a-40bb-8026-c6011792a174]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:25 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d Sep 28 12:20:25 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:26 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d" returned: 0 in 0.488s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1401a2f-c011-4810-bf4d-1ce431c51f22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:20:26 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1e48eb-41b7-4c7e-87c3-8a3c7c65ed30]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:26 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 Sep 28 12:20:26 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:26 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22" returned: 0 in 0.570s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:26 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d Sep 28 12:20:26 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:27 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d" returned: 0 in 0.412s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:27 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d Sep 28 12:20:27 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:27 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22.4eb57c25-f4bf-4bfb-859c-648c9cc1260d" returned: 0 in 0.302s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Lock "cinder-quobyte-4eb57c25-f4bf-4bfb-859c-648c9cc1260d" released by "_delete_snapshot" :: held 1.902s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.290s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.137s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1992832144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c9fb077-3c76-4420-bfde-9bb86648de54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef380b527034e1aab74b1a2c2c24857',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:14Z,use_quota=True,user_id='7d7196d943e74bbaa4fb8ecf1858e010',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Creating volume 3c9fb077-3c76-4420-bfde-9bb86648de54 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:27 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6fc323-14d4-4bda-b86c-0b01062c6f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b', 'volume_size': 2, 'source_volid': 'b1401a2f-c011-4810-bf4d-1ce431c51f22', 'source_volstatus': 'available'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d3ba99-c467-47e9-8d56-30c744fafc5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:27 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54 1073741824 Sep 28 12:20:27 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:27 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Volume volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b (ae89223e-fa58-4ebd-879b-6fa5e337df4b): created successfully Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d3ba99-c467-47e9-8d56-30c744fafc5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Flow 'volume_create_manager' (91ff60d4-ec8f-40b3-840f-78e4ed6b5080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4bea9a36-8da0-437d-be47-306884ed01e8 tempest-VolumesCloneTest-569139357 None] Created volume successfully. Sep 28 12:20:28 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54 1073741824" returned: 0 in 0.471s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:28 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54 Sep 28 12:20:28 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:28 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54" returned: 0 in 0.502s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401d97cd-9d9b-4e56-a9ba-7d5d4da9990d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c9fb077-3c76-4420-bfde-9bb86648de54', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffee489-1a78-46c8-8364-bc196b94ac88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:28 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Volume volume-3c9fb077-3c76-4420-bfde-9bb86648de54 (3c9fb077-3c76-4420-bfde-9bb86648de54): created successfully Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffee489-1a78-46c8-8364-bc196b94ac88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Flow 'volume_create_manager' (9466c9b0-02f3-4a69-94f5-c6ec82361462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b6acc492-8a20-482f-bd14-840f5c8d6bcc tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Created volume successfully. Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Acquiring lock "cinder-ae89223e-fa58-4ebd-879b-6fa5e337df4b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Lock "cinder-ae89223e-fa58-4ebd-879b-6fa5e337df4b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Acquiring lock "cinder-quobyte-ae89223e-fa58-4ebd-879b-6fa5e337df4b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Lock "cinder-quobyte-ae89223e-fa58-4ebd-879b-6fa5e337df4b" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceedd9b2-c6dc-4988-a5e4-152b15870c89]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:29 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b Sep 28 12:20:29 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:29 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b" returned: 0 in 0.535s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:29 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b Sep 28 12:20:29 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:29 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ae89223e-fa58-4ebd-879b-6fa5e337df4b" returned: 0 in 0.376s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Lock "cinder-quobyte-ae89223e-fa58-4ebd-879b-6fa5e337df4b" released by "delete_volume" :: held 0.990s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Created reservations ['2bd24333-652f-45aa-abdb-ae1682ee2ae6', 'b41e4d94-a0c5-4e0a-a9fa-2761c6ea9027', 'dd57dd53-6e97-4347-aa0f-f20e5329cc82', 'b173d9c1-94ae-4a0f-a95b-5cc49d7b5285'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:30 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:30 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Acquiring lock "cinder-3c9fb077-3c76-4420-bfde-9bb86648de54-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "cinder-3c9fb077-3c76-4420-bfde-9bb86648de54-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Acquiring lock "cinder-quobyte-3c9fb077-3c76-4420-bfde-9bb86648de54" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "cinder-quobyte-3c9fb077-3c76-4420-bfde-9bb86648de54" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:30 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7095ef4-08ae-463a-9137-35b176461d46]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.452s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:30 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Deleted volume successfully. Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9ad57431-33a6-4017-881a-378cb4986db3 tempest-VolumesCloneTest-569139357 None] Lock "cinder-ae89223e-fa58-4ebd-879b-6fa5e337df4b-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:30 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54 Sep 28 12:20:30 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:30 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54" returned: 0 in 0.436s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:31 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54 Sep 28 12:20:31 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:31 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3c9fb077-3c76-4420-bfde-9bb86648de54" returned: 0 in 0.278s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "cinder-quobyte-3c9fb077-3c76-4420-bfde-9bb86648de54" released by "delete_volume" :: held 0.771s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Acquiring lock "cinder-b1401a2f-c011-4810-bf4d-1ce431c51f22-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Created reservations ['d41f9f93-c86b-4425-b5a4-a732cfa367dc', 'e0ed952d-3ab0-4417-b14b-ac6973f63f1c', '23305828-e15c-4e8b-b736-07aadd20ba65', '3ecc376b-8f94-4e73-822e-a748e45a8517'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Lock "cinder-b1401a2f-c011-4810-bf4d-1ce431c51f22-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Acquiring lock "cinder-quobyte-b1401a2f-c011-4810-bf4d-1ce431c51f22" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Lock "cinder-quobyte-b1401a2f-c011-4810-bf4d-1ce431c51f22" acquired by "delete_volume" :: waited 0.043s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43a56bd-46ca-40c7-a20f-df933b0546ba]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:31 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:31 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:31 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 Sep 28 12:20:31 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:32 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.521s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:32 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Deleted volume successfully. Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6dc7a0be-12c4-4083-aeba-95a4e52e03b6 tempest-VolumeQuotasNegativeTestJSON-1506970726 None] Lock "cinder-3c9fb077-3c76-4420-bfde-9bb86648de54-delete_volume" released by "delete_volume" :: held 1.793s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:32 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22" returned: 0 in 0.800s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:32 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22 Sep 28 12:20:32 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:32 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b1401a2f-c011-4810-bf4d-1ce431c51f22" returned: 0 in 0.329s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Lock "cinder-quobyte-b1401a2f-c011-4810-bf4d-1ce431c51f22" released by "delete_volume" :: held 1.245s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Created reservations ['f8baa93a-7af0-4eba-93c5-ea6623d20749', 'cb1ae3c3-4cf4-4956-b924-e9df0327f034', '3832d06c-4087-4756-ba62-7fe68982302e', '4a1438a8-97c5-4826-b4ac-47fa03fffc05'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:32 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:32 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:33 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.264s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:33 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Deleted volume successfully. Sep 28 12:20:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-593c450e-7dd6-4dab-badf-9fa33a613c8e tempest-VolumesCloneTest-569139357 None] Lock "cinder-b1401a2f-c011-4810-bf4d-1ce431c51f22-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:38 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:38 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:38 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.412s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:20:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Flow 'volume_create_manager' (15e14f7d-a512-4c9b-8cf1-dc2775197df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5161b05-502d-4e45-ace9-14a38de4a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5161b05-502d-4e45-ace9-14a38de4a17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1222312019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c607d79e-dc29-4fbb-b186-d436f1e48818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb22b97e335f4b3dbc9e841358ebdec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:39Z,use_quota=True,user_id='bfb3e35e5f694cf6a4db6638302ca96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d681a1-b6cd-4031-8093-7ccf2a1ab067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4d681a1-b6cd-4031-8093-7ccf2a1ab067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9962d08f-df22-4078-a3a6-1bd64b27769b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9962d08f-df22-4078-a3a6-1bd64b27769b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c607d79e-dc29-4fbb-b186-d436f1e48818', 'volume_name': 'volume-c607d79e-dc29-4fbb-b186-d436f1e48818', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494b06cd-87e9-482e-8790-8dd8f75dc28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (494b06cd-87e9-482e-8790-8dd8f75dc28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ae1e2e-9c9a-4824-bb2d-6026c91fef76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:39 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Volume c607d79e-dc29-4fbb-b186-d436f1e48818: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c607d79e-dc29-4fbb-b186-d436f1e48818', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:20:39 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Trying to clone c607d79e-dc29-4fbb-b186-d436f1e48818 from image d446342e-1c65-4f57-97fb-ae62bc9167ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:20:40 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60193be-32ef-49a5-9114-2255bcc56d5d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:40 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD Sep 28 12:20:40 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Flow 'volume_create_manager' (60297403-fc7b-4e7c-a3a9-f0323c19ab04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93af8e2d-ac46-45df-b286-fbd7f9c81c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef is fetched for user bfb3e35e5f694cf6a4db6638302ca96e. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93af8e2d-ac46-45df-b286-fbd7f9c81c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-67157632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6545dc-3187-4b2a-aa30-a9a8379adfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c880d9d05041818a56b66b274690c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:41Z,use_quota=True,user_id='0ce2fd33cef24b07b195744941b2f6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8aee234-2ed5-4b9d-b390-120abd6594e0),volume_type_id=b8aee234-2ed5-4b9d-b390-120abd6594e0)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c0abe-7df7-4f0a-941a-ca809f2b56df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9c0abe-7df7-4f0a-941a-ca809f2b56df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab679549-7287-41a9-bae3-be00aba76182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab679549-7287-41a9-bae3-be00aba76182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e6545dc-3187-4b2a-aa30-a9a8379adfbb', 'volume_name': 'volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ae79d6-0408-43c6-af6a-81ef259f5603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9ae79d6-0408-43c6-af6a-81ef259f5603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6baad0-30fe-4eb7-aced-4cb1de5dc865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:40 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Volume 0e6545dc-3187-4b2a-aa30-a9a8379adfbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb', 'volume_size': 1} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-67157632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e6545dc-3187-4b2a-aa30-a9a8379adfbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c880d9d05041818a56b66b274690c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:41Z,use_quota=True,user_id='0ce2fd33cef24b07b195744941b2f6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8aee234-2ed5-4b9d-b390-120abd6594e0),volume_type_id=b8aee234-2ed5-4b9d-b390-120abd6594e0)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Creating volume 0e6545dc-3187-4b2a-aa30-a9a8379adfbb {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:40 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:40 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb 1073741824 Sep 28 12:20:40 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b890a554-ecbf-49ce-b755-f43d0f600fa9]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:41 devstack sudo[96890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD Sep 28 12:20:41 devstack sudo[96890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:41 devstack sudo[96890]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:41 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb 1073741824" returned: 0 in 0.583s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:41 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb Sep 28 12:20:41 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:41 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb" returned: 0 in 0.318s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1222312019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c607d79e-dc29-4fbb-b186-d436f1e48818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb22b97e335f4b3dbc9e841358ebdec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:39Z,use_quota=True,user_id='bfb3e35e5f694cf6a4db6638302ca96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Creating volume c607d79e-dc29-4fbb-b186-d436f1e48818 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:41 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6baad0-30fe-4eb7-aced-4cb1de5dc865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaac952-f971-4a1f-9047-9f01fe1210dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:41 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 1073741824 Sep 28 12:20:41 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:41 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Volume volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb (0e6545dc-3187-4b2a-aa30-a9a8379adfbb): created successfully Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaaac952-f971-4a1f-9047-9f01fe1210dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Flow 'volume_create_manager' (60297403-fc7b-4e7c-a3a9-f0323c19ab04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:41 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ce93118f-b813-4b17-82c0-d3ec8dbb4d80 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Created volume successfully. Sep 28 12:20:42 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 1073741824" returned: 0 in 0.531s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:42 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 Sep 28 12:20:42 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:42 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818" returned: 0 in 0.265s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:42 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Attempting download of d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume c607d79e-dc29-4fbb-b186-d436f1e48818. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:20:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8805c296-041b-418f-bb81-8b0e392bcf61]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_gb3t2g7x {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:43 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_gb3t2g7x Sep 28 12:20:43 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:43 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_gb3t2g7x" returned: 0 in 0.464s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_gb3t2g7x {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Flow 'volume_create_manager' (71ea3c06-b15b-4f96-911f-ed1ec4dc33f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f86d7a1-0365-4c4c-9764-7608d77c0c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:43 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_gb3t2g7x Sep 28 12:20:43 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f86d7a1-0365-4c4c-9764-7608d77c0c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1986278921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcba68a9-b298-438d-8f45-992ba2e09f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673c566bb7a94608bba9eefe57d67da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:43Z,use_quota=True,user_id='47d354b0accb455f9352fd2de8638cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0bb9ad-a838-4a6f-99f9-ee814658aa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0bb9ad-a838-4a6f-99f9-ee814658aa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377ee150-d274-4d23-8d30-0b320bac394d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (377ee150-d274-4d23-8d30-0b320bac394d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcba68a9-b298-438d-8f45-992ba2e09f7f', 'volume_name': 'volume-dcba68a9-b298-438d-8f45-992ba2e09f7f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387a4235-b952-4658-a353-505dfc242958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387a4235-b952-4658-a353-505dfc242958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d57b10a-ed12-4f2c-bc5e-1d3a380c806d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:43 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Volume dcba68a9-b298-438d-8f45-992ba2e09f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcba68a9-b298-438d-8f45-992ba2e09f7f', 'volume_size': 1} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1986278921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcba68a9-b298-438d-8f45-992ba2e09f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673c566bb7a94608bba9eefe57d67da3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:43Z,use_quota=True,user_id='47d354b0accb455f9352fd2de8638cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Creating volume dcba68a9-b298-438d-8f45-992ba2e09f7f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:43 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=106,cinder:SELECT=91,cinder:INSERT=33,cinder:DELETE=8 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:20:43 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f 1073741824 Sep 28 12:20:43 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:43 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_gb3t2g7x" returned: 1 in 0.379s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_gb3t2g7x' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd7451a-76a1-49d7-87c2-40b72e16eeee]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c0d50fee-b7ae-48f5-a3de-31ee1b611784 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c0d50fee-b7ae-48f5-a3de-31ee1b611784 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c0d50fee-b7ae-48f5-a3de-31ee1b611784 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c0d50fee-b7ae-48f5-a3de-31ee1b611784 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c0d50fee-b7ae-48f5-a3de-31ee1b611784 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c0d50fee-b7ae-48f5-a3de-31ee1b611784 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:43 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:43 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:43 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD Sep 28 12:20:43 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:43 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c0d50fee-b7ae-48f5-a3de-31ee1b611784 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.280s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-c0d50fee-b7ae-48f5-a3de-31ee1b611784 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c0d50fee-b7ae-48f5-a3de-31ee1b611784 tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Retype volume completed successfully. Sep 28 12:20:44 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] d446342e-1c65-4f57-97fb-ae62bc9167ef was qcow2, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:44 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f 1073741824" returned: 0 in 0.567s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:44 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 Sep 28 12:20:44 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:44 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f Sep 28 12:20:44 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:44 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f" returned: 0 in 0.315s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=99,cinder:UPDATE=103,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d57b10a-ed12-4f2c-bc5e-1d3a380c806d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcba68a9-b298-438d-8f45-992ba2e09f7f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6895f4-0b20-4216-a900-8f5832f4b8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:44 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Volume volume-dcba68a9-b298-438d-8f45-992ba2e09f7f (dcba68a9-b298-438d-8f45-992ba2e09f7f): created successfully Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b6895f4-0b20-4216-a900-8f5832f4b8f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Flow 'volume_create_manager' (71ea3c06-b15b-4f96-911f-ed1ec4dc33f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1d01ee4f-c533-4a1a-93f8-3027bd37cddc tempest-AttachVolumeShelveTestJSON-1571735433 None] Created volume successfully. Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Acquiring lock "cinder-0e6545dc-3187-4b2a-aa30-a9a8379adfbb-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "cinder-0e6545dc-3187-4b2a-aa30-a9a8379adfbb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Acquiring lock "cinder-quobyte-0e6545dc-3187-4b2a-aa30-a9a8379adfbb" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "cinder-quobyte-0e6545dc-3187-4b2a-aa30-a9a8379adfbb" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4f4f5f-9213-4ebc-ba4b-4511aaac5d59]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:45 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb Sep 28 12:20:45 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:45 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb" returned: 0 in 0.499s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:45 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb Sep 28 12:20:45 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:45 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0e6545dc-3187-4b2a-aa30-a9a8379adfbb" returned: 0 in 0.346s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "cinder-quobyte-0e6545dc-3187-4b2a-aa30-a9a8379adfbb" released by "delete_volume" :: held 0.899s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:45 devstack cinder-volume[87048]: WARNING cinder.quota [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:20:45 devstack cinder-volume[87048]: WARNING cinder.quota [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Created reservations ['fe89fb86-d521-4fd4-903b-733ea076d4c2', 'd0fa5b0e-a4af-456c-8865-d9ea13c54655', '3cffbdcd-3f53-4312-9ed6-48b91cdd563a', '5de76317-b239-400f-8fd6-c1abbe0fab2a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:46 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:46 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:46 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.472s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:46 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Deleted volume successfully. Sep 28 12:20:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-295cf9b6-1190-4d7c-a28e-ddfbe2a5324f tempest-VolumeRetypeWithoutMigrationTest-1754371996 None] Lock "cinder-0e6545dc-3187-4b2a-aa30-a9a8379adfbb-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:46 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818" returned: 0 in 2.779s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:46 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_0dwkuzeodevstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:20:46 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Converted 112.00 MB image at 40.29 MB/s Sep 28 12:20:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:46 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 1G Sep 28 12:20:46 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:47 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 1G" returned: 0 in 0.513s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Downloaded image d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume c607d79e-dc29-4fbb-b186-d436f1e48818 successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef for user bfb3e35e5f694cf6a4db6638302ca96e is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Marking volume c607d79e-dc29-4fbb-b186-d436f1e48818 as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Copying metadata from image d446342e-1c65-4f57-97fb-ae62bc9167ef to c607d79e-dc29-4fbb-b186-d436f1e48818. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Creating volume glance metadata for volume c607d79e-dc29-4fbb-b186-d436f1e48818 backed by image d446342e-1c65-4f57-97fb-ae62bc9167ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ae1e2e-9c9a-4824-bb2d-6026c91fef76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c607d79e-dc29-4fbb-b186-d436f1e48818', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687f7e43-aa2e-4813-9b56-7b6f02c712e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:47 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Volume volume-c607d79e-dc29-4fbb-b186-d436f1e48818 (c607d79e-dc29-4fbb-b186-d436f1e48818): created successfully Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (687f7e43-aa2e-4813-9b56-7b6f02c712e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Flow 'volume_create_manager' (15e14f7d-a512-4c9b-8cf1-dc2775197df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:47 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a895bb0c-4361-4484-82bd-15b66e82d90c tempest-VolumesExtendTest-1666333063 None] Created volume successfully. Sep 28 12:20:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e126bda7-2d7d-4092-9a98-e52dd3f1b6bd tempest-VolumesExtendTest-1666333063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e126bda7-2d7d-4092-9a98-e52dd3f1b6bd tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:48 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7e72d7-f05b-487c-85ca-8a7068a4cbab]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e126bda7-2d7d-4092-9a98-e52dd3f1b6bd tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:48 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 Sep 28 12:20:48 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:48 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e126bda7-2d7d-4092-9a98-e52dd3f1b6bd tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818" returned: 0 in 0.557s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e126bda7-2d7d-4092-9a98-e52dd3f1b6bd tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 2G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e126bda7-2d7d-4092-9a98-e52dd3f1b6bd tempest-VolumesExtendTest-1666333063 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 2G" returned: 0 in 0.159s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e126bda7-2d7d-4092-9a98-e52dd3f1b6bd tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.757s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e126bda7-2d7d-4092-9a98-e52dd3f1b6bd tempest-VolumesExtendTest-1666333063 None] Extend volume completed successfully. Sep 28 12:20:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "cinder-c607d79e-dc29-4fbb-b186-d436f1e48818-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-c607d79e-dc29-4fbb-b186-d436f1e48818-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "cinder-quobyte-c607d79e-dc29-4fbb-b186-d436f1e48818" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:20:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-quobyte-c607d79e-dc29-4fbb-b186-d436f1e48818" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:20:50 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7f7b44-2a66-40fa-b52b-1b4aa56ea791]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:50 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 Sep 28 12:20:50 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:50 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818" returned: 0 in 0.541s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:50 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818 Sep 28 12:20:50 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:51 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c607d79e-dc29-4fbb-b186-d436f1e48818" returned: 0 in 0.335s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-quobyte-c607d79e-dc29-4fbb-b186-d436f1e48818" released by "delete_volume" :: held 0.932s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Created reservations ['83ea220b-5e61-405d-a47d-abb24c158438', '465ae138-1e27-44e3-8bbd-237cefa9e29f', 'a12a34ec-f423-4fa6-937c-0d217be49a92', '933d49ab-83e4-4c83-8821-209d861faf1b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:51 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:20:51 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:51 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.372s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:20:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Deleted volume successfully. Sep 28 12:20:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b37f8d2d-2154-43dd-92f3-1ca075967ea3 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-c607d79e-dc29-4fbb-b186-d436f1e48818-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Flow 'volume_create_manager' (6065e4af-e25d-4490-9e73-22bae3978cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24ba733-cd10-40b8-b095-498cbdf1192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24ba733-cd10-40b8-b095-498cbdf1192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2061881784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518ba2da-3b49-443d-9982-727eb241f992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb22b97e335f4b3dbc9e841358ebdec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:53Z,use_quota=True,user_id='bfb3e35e5f694cf6a4db6638302ca96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b533853a-de84-40d4-9b69-627209b11a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b533853a-de84-40d4-9b69-627209b11a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7f2026-5a18-452d-82ce-eb51bfd94a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7f2026-5a18-452d-82ce-eb51bfd94a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '518ba2da-3b49-443d-9982-727eb241f992', 'volume_name': 'volume-518ba2da-3b49-443d-9982-727eb241f992', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbb3f2d-749c-477e-b1b8-9000f1af5b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fbb3f2d-749c-477e-b1b8-9000f1af5b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32516af8-d37b-493f-a631-a12d2548e53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:53 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Volume 518ba2da-3b49-443d-9982-727eb241f992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-518ba2da-3b49-443d-9982-727eb241f992', 'volume_size': 1} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:20:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2061881784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=518ba2da-3b49-443d-9982-727eb241f992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb22b97e335f4b3dbc9e841358ebdec0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:20:53Z,use_quota=True,user_id='bfb3e35e5f694cf6a4db6638302ca96e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Creating volume 518ba2da-3b49-443d-9982-727eb241f992 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:20:53 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:53 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 1073741824 Sep 28 12:20:53 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:53 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 1073741824" returned: 0 in 0.700s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:54 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 Sep 28 12:20:54 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:54 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992" returned: 0 in 0.361s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:20:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32516af8-d37b-493f-a631-a12d2548e53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-518ba2da-3b49-443d-9982-727eb241f992', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fb6c63-933f-46a8-bba0-be61042405ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:20:54 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Volume volume-518ba2da-3b49-443d-9982-727eb241f992 (518ba2da-3b49-443d-9982-727eb241f992): created successfully Sep 28 12:20:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29fb6c63-933f-46a8-bba0-be61042405ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:20:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Flow 'volume_create_manager' (6065e4af-e25d-4490-9e73-22bae3978cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:20:54 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2f123b2f-40e4-4b5c-82bd-8ab858340292 tempest-VolumesExtendTest-1666333063 None] Created volume successfully. Sep 28 12:20:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:20:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Creating offline snapshot 3b979a57-e321-4070-86e5-8ada7d6fd10c of volume 518ba2da-3b49-443d-9982-727eb241f992 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:20:55 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc6d1f7-1161-4352-af4b-5718d956eaf5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:20:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:55 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 Sep 28 12:20:55 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:56 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992" returned: 0 in 0.767s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:56 devstack sudo[97042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c 1G Sep 28 12:20:56 devstack sudo[97042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:57 devstack sudo[97042]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c 1G" returned: 0 in 0.730s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-518ba2da-3b49-443d-9982-727eb241f992 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:57 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-518ba2da-3b49-443d-9982-727eb241f992 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c Sep 28 12:20:57 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:57 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-518ba2da-3b49-443d-9982-727eb241f992 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c" returned: 0 in 0.376s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:57 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c is being set with open permissions: ugo+rw Sep 28 12:20:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:57 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c Sep 28 12:20:57 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:57 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c" returned: 0 in 0.335s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:57 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.info Sep 28 12:20:57 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:58 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.info" returned: 0 in 0.376s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:58 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.info is being set with open permissions: ugo+rw Sep 28 12:20:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:20:58 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.info Sep 28 12:20:58 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:20:58 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Sep 28 12:20:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.info" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:20:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.092s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:20:58 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-bbe782c0-8ed4-44ad-a149-fe3ad13041ac tempest-VolumesExtendTest-1666333063 None] Create snapshot completed successfully Sep 28 12:20:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-54d68dd2-babd-4584-9796-5d8c8ff2e067 req-e46466ac-2bfd-4cfb-98ae-ee7dea9fa9e0 tempest-AttachVolumeShelveTestJSON-1571735433 None] No connector for attachment 04a5d809-a889-4f7e-a441-cb91207ed521; skipping storage backend terminate_connection call. {{(pid=87048) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 12:20:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-54d68dd2-babd-4584-9796-5d8c8ff2e067 req-e46466ac-2bfd-4cfb-98ae-ee7dea9fa9e0 tempest-AttachVolumeShelveTestJSON-1571735433 None] Deleting attachment 04a5d809-a889-4f7e-a441-cb91207ed521. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:20:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3579b9f8-4b26-406b-8764-e73f6a225079 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:20:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3579b9f8-4b26-406b-8764-e73f6a225079 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4dbcc3-f8fe-487e-ad87-75bdca07115f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3579b9f8-4b26-406b-8764-e73f6a225079 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:00 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 Sep 28 12:21:00 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:00 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3579b9f8-4b26-406b-8764-e73f6a225079 tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992" returned: 0 in 0.724s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3579b9f8-4b26-406b-8764-e73f6a225079 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c 2G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3579b9f8-4b26-406b-8764-e73f6a225079 tempest-VolumesExtendTest-1666333063 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c 2G" returned: 0 in 0.230s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3579b9f8-4b26-406b-8764-e73f6a225079 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3579b9f8-4b26-406b-8764-e73f6a225079 tempest-VolumesExtendTest-1666333063 None] Extend volume completed successfully. Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "cinder-3b979a57-e321-4070-86e5-8ada7d6fd10c-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-3b979a57-e321-4070-86e5-8ada7d6fd10c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "cinder-quobyte-518ba2da-3b49-443d-9982-727eb241f992" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-quobyte-518ba2da-3b49-443d-9982-727eb241f992" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "cinder-quobyte-3b979a57-e321-4070-86e5-8ada7d6fd10c" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-quobyte-3b979a57-e321-4070-86e5-8ada7d6fd10c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Deleting offline snapshot 3b979a57-e321-4070-86e5-8ada7d6fd10c of volume 518ba2da-3b49-443d-9982-727eb241f992 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] snapshot_file for this snap is: volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7ff94e-261a-43de-87aa-77d2ba21afe7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:02 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c Sep 28 12:21:02 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:03 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c" returned: 0 in 0.473s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-518ba2da-3b49-443d-9982-727eb241f992(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:21:03 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c883b4a3-c92f-46cd-b2d1-68918d0efb33]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:03 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 Sep 28 12:21:03 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:04 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992" returned: 0 in 0.861s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:04 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c Sep 28 12:21:04 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:04 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c" returned: 0 in 0.643s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:04 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c Sep 28 12:21:04 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:05 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992.3b979a57-e321-4070-86e5-8ada7d6fd10c" returned: 0 in 0.407s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-quobyte-3b979a57-e321-4070-86e5-8ada7d6fd10c" released by "_delete_snapshot" :: held 2.603s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-quobyte-518ba2da-3b49-443d-9982-727eb241f992" released by "delete_snapshot" :: held 2.647s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:05 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Created reservations ['4e8988b0-1eaf-4eb8-b1df-dfc8261c91b3', 'a606509e-c972-42de-8fdc-8dcfa4e81419', '6c6a0060-c4ac-4f16-9186-a7f89acd827a', 'fc69fc01-e287-419b-81b9-407e7310773a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:05 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Delete snapshot completed successfully. Sep 28 12:21:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2b1b0dec-b594-48c6-abbe-cd664f0729e6 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-3b979a57-e321-4070-86e5-8ada7d6fd10c-delete_snapshot" released by "delete_snapshot" :: held 2.913s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "cinder-518ba2da-3b49-443d-9982-727eb241f992-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-518ba2da-3b49-443d-9982-727eb241f992-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "cinder-quobyte-518ba2da-3b49-443d-9982-727eb241f992" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-quobyte-518ba2da-3b49-443d-9982-727eb241f992" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:06 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4102d7-21e8-4e7a-aad8-f28fd816bebc]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:06 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 Sep 28 12:21:06 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:06 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992" returned: 0 in 0.442s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:06 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992 Sep 28 12:21:06 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:06 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-518ba2da-3b49-443d-9982-727eb241f992" returned: 0 in 0.313s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-quobyte-518ba2da-3b49-443d-9982-727eb241f992" released by "delete_volume" :: held 0.848s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:06 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Created reservations ['e2535202-f735-40ac-aaee-1ea4ac714604', '5c690cec-9873-4dc6-9a7e-22dd8c4618eb', 'ea9186e2-a96b-408c-ab77-23a5b5eca8b9', '84ce257e-743d-412d-9dae-4f055322eb0f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:07 devstack sudo[97148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:21:07 devstack sudo[97148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:07 devstack sudo[97148]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.373s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:07 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:07 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Deleted volume successfully. Sep 28 12:21:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-767ad62c-eafb-4954-b500-44f3d29f8a36 tempest-VolumesExtendTest-1666333063 None] Lock "cinder-518ba2da-3b49-443d-9982-727eb241f992-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Flow 'volume_create_manager' (380e35df-6136-4a53-bb5e-7a8fbde1c438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdad5b5f-f490-418c-a5d0-90bc50e7bd30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdad5b5f-f490-418c-a5d0-90bc50e7bd30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1798858555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0768f2c5-88c1-481e-abb1-8ba08fdf109b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d40d7b9a31d4e5db03e2ee233afa013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:16Z,use_quota=True,user_id='664d765fc4244a549d94a2aa4fae68ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453e2887-679b-44ed-a621-62a381b5e4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453e2887-679b-44ed-a621-62a381b5e4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88629b2-4ed1-4d98-8481-d16dd893df80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f88629b2-4ed1-4d98-8481-d16dd893df80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0768f2c5-88c1-481e-abb1-8ba08fdf109b', 'volume_name': 'volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5195698a-8e86-4842-8fdc-7393b80fcf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5195698a-8e86-4842-8fdc-7393b80fcf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19e70d0-3dff-4eac-af33-9c90d06fc859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:15 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Volume 0768f2c5-88c1-481e-abb1-8ba08fdf109b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b', 'volume_size': 1} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1798858555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0768f2c5-88c1-481e-abb1-8ba08fdf109b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d40d7b9a31d4e5db03e2ee233afa013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:16Z,use_quota=True,user_id='664d765fc4244a549d94a2aa4fae68ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Creating volume 0768f2c5-88c1-481e-abb1-8ba08fdf109b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:15 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:21:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:15 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b 1073741824 Sep 28 12:21:15 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:16 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b 1073741824" returned: 0 in 0.825s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:16 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b Sep 28 12:21:16 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:17 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b" returned: 0 in 0.424s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:21:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19e70d0-3dff-4eac-af33-9c90d06fc859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ad9f1a-df56-4b05-b0aa-454f8c65b2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:17 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Volume volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b (0768f2c5-88c1-481e-abb1-8ba08fdf109b): created successfully Sep 28 12:21:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ad9f1a-df56-4b05-b0aa-454f8c65b2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Flow 'volume_create_manager' (380e35df-6136-4a53-bb5e-7a8fbde1c438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b2be1a09-d9ee-48ae-af0c-c483da8c2464 tempest-VolumesNegativeTest-828308420 None] Created volume successfully. Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Flow 'volume_create_manager' (c6646c6f-f803-4b36-a3a3-9ec9cb5ed3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b20fe2-3009-4a98-9b95-7ac755d027b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9b20fe2-3009-4a98-9b95-7ac755d027b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1558212372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379a5ba3-238c-4450-b486-311a79cff2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a09c7ae42dd42b0936a544dd58cfecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:26Z,use_quota=True,user_id='e3c7a31f10024c02b50570c971867cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6a1783-7e8e-42ef-95c6-08f625d23d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c6a1783-7e8e-42ef-95c6-08f625d23d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c70ca9-09d3-454c-9108-8e105adb43b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c70ca9-09d3-454c-9108-8e105adb43b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '379a5ba3-238c-4450-b486-311a79cff2dc', 'volume_name': 'volume-379a5ba3-238c-4450-b486-311a79cff2dc', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f97d2fb-ec13-4714-b5fd-72e32ee993a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f97d2fb-ec13-4714-b5fd-72e32ee993a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08672116-8377-44e5-b622-d2e40da61bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:26 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Volume 379a5ba3-238c-4450-b486-311a79cff2dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-379a5ba3-238c-4450-b486-311a79cff2dc', 'volume_size': 1} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1558212372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=379a5ba3-238c-4450-b486-311a79cff2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a09c7ae42dd42b0936a544dd58cfecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:26Z,use_quota=True,user_id='e3c7a31f10024c02b50570c971867cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Creating volume 379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.067s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:26 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:21:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:26 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc 1073741824 Sep 28 12:21:26 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:27 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc 1073741824" returned: 0 in 1.065s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:27 devstack sudo[97396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc Sep 28 12:21:27 devstack sudo[97396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:28 devstack sudo[97396]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc" returned: 0 in 0.639s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:21:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08672116-8377-44e5-b622-d2e40da61bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-379a5ba3-238c-4450-b486-311a79cff2dc', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3bd019-ea0c-43fb-b722-8eaeefd07b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:28 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Volume volume-379a5ba3-238c-4450-b486-311a79cff2dc (379a5ba3-238c-4450-b486-311a79cff2dc): created successfully Sep 28 12:21:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3bd019-ea0c-43fb-b722-8eaeefd07b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Flow 'volume_create_manager' (c6646c6f-f803-4b36-a3a3-9ec9cb5ed3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a88e0f00-2aca-4efb-8220-bdbcba464a7b tempest-VolumesDeleteCascade-859832742 None] Created volume successfully. Sep 28 12:21:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Creating offline snapshot 86d3c684-eedd-4e1b-b298-b67ace56da50 of volume 379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:21:30 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e402ddf-c89f-497a-a8aa-bd3ddce19dfd]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:30 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc Sep 28 12:21:30 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:31 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc" returned: 0 in 1.374s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:31 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 1G Sep 28 12:21:31 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:32 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 1G" returned: 0 in 0.965s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a5ba3-238c-4450-b486-311a79cff2dc -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:32 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a5ba3-238c-4450-b486-311a79cff2dc -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 Sep 28 12:21:32 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:33 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a5ba3-238c-4450-b486-311a79cff2dc -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50" returned: 0 in 0.449s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:33 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 is being set with open permissions: ugo+rw Sep 28 12:21:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:33 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 Sep 28 12:21:33 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:33 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50" returned: 0 in 0.466s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:33 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.info Sep 28 12:21:33 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:34 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.info" returned: 0 in 0.831s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:34 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.info is being set with open permissions: ugo+rw Sep 28 12:21:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:34 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.info Sep 28 12:21:34 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:35 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.info" returned: 0 in 0.538s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.860s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-15aca72b-7321-4bfb-aea1-0ed07b6acccc tempest-VolumesDeleteCascade-859832742 None] Create snapshot completed successfully Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Flow 'volume_create_manager' (89b78e6a-5a42-42bb-8397-0b92bbdaf79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00eadcf8-3eb7-4575-bd0a-fbbbed99b379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00eadcf8-3eb7-4575-bd0a-fbbbed99b379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1269871801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f10b3c-bea1-43d1-836e-127ac7fb3d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cea596aa7e842829d854ac9d3068fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:36Z,use_quota=True,user_id='745c750a924f407696dba35efd4a7204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30533f60-4b02-459b-9d59-6b4a82f7d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30533f60-4b02-459b-9d59-6b4a82f7d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8210d276-9dc8-4439-8d3e-04ad5982d4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8210d276-9dc8-4439-8d3e-04ad5982d4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28f10b3c-bea1-43d1-836e-127ac7fb3d9f', 'volume_name': 'volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69458ee7-0029-4060-ad96-4ad6dc648cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69458ee7-0029-4060-ad96-4ad6dc648cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fe4d6b-bbf2-4d75-848e-c3dd75f86e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:36 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Volume 28f10b3c-bea1-43d1-836e-127ac7fb3d9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f', 'volume_size': 1} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1269871801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28f10b3c-bea1-43d1-836e-127ac7fb3d9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cea596aa7e842829d854ac9d3068fe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:36Z,use_quota=True,user_id='745c750a924f407696dba35efd4a7204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Creating volume 28f10b3c-bea1-43d1-836e-127ac7fb3d9f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:36 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:36 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f 1073741824 Sep 28 12:21:36 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:36 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f 1073741824" returned: 0 in 0.696s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:37 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f Sep 28 12:21:37 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:37 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f" returned: 0 in 0.344s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.055s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43fe4d6b-bbf2-4d75-848e-c3dd75f86e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e72dd8-496d-4b39-9129-206b9c0c02b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Creating offline snapshot d30bbca8-0bb8-4b89-81ee-adbeb29bd511 of volume 379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:21:37 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Volume volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f (28f10b3c-bea1-43d1-836e-127ac7fb3d9f): created successfully Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e72dd8-496d-4b39-9129-206b9c0c02b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Flow 'volume_create_manager' (89b78e6a-5a42-42bb-8397-0b92bbdaf79e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2a0cee-0f4c-4261-bca8-cee720c9538c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:37 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-44d131a5-ceff-4ab4-ac48-130c906ac0fa tempest-TestMinimumBasicScenario-1033946683 None] Created volume successfully. Sep 28 12:21:37 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 Sep 28 12:21:37 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:37 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50" returned: 0 in 0.506s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-379a5ba3-238c-4450-b486-311a79cff2dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:21:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:38 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 1G Sep 28 12:21:38 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:38 devstack sudo[97585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:21:38 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:38 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.535s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:21:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:21:39 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 1G" returned: 0 in 1.055s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:39 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 Sep 28 12:21:39 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:39 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-a5b0ce16-8296-4c44-91f9-f3e00c6ac652 req-b5888ed0-5c21-4fbb-9bcd-7b301c670fb5 tempest-TestMinimumBasicScenario-1033946683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511" returned: 0 in 0.384s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:39 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 is being set with open permissions: ugo+rw Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:39 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 Sep 28 12:21:39 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:39 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511" returned: 0 in 0.313s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.446s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-a5b0ce16-8296-4c44-91f9-f3e00c6ac652 req-b5888ed0-5c21-4fbb-9bcd-7b301c670fb5 tempest-TestMinimumBasicScenario-1033946683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.354s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-a5b0ce16-8296-4c44-91f9-f3e00c6ac652 req-b5888ed0-5c21-4fbb-9bcd-7b301c670fb5 tempest-TestMinimumBasicScenario-1033946683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0992db46-a926-4f87-b317-7acda1b439cc tempest-VolumesDeleteCascade-859832742 None] Create snapshot completed successfully Sep 28 12:21:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-a5b0ce16-8296-4c44-91f9-f3e00c6ac652 req-b5888ed0-5c21-4fbb-9bcd-7b301c670fb5 tempest-TestMinimumBasicScenario-1033946683 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc8fd70f-888a-48d4-8825-22b753ee7ca9', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:21:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-a5b0ce16-8296-4c44-91f9-f3e00c6ac652 req-b5888ed0-5c21-4fbb-9bcd-7b301c670fb5 tempest-TestMinimumBasicScenario-1033946683 None] attachment_update completed successfully. Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-379a5ba3-238c-4450-b486-311a79cff2dc-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-379a5ba3-238c-4450-b486-311a79cff2dc-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Performing cascade delete. {{(pid=87048) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-86d3c684-eedd-4e1b-b298-b67ace56da50-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-86d3c684-eedd-4e1b-b298-b67ace56da50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-379a5ba3-238c-4450-b486-311a79cff2dc" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-379a5ba3-238c-4450-b486-311a79cff2dc" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-86d3c684-eedd-4e1b-b298-b67ace56da50" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-86d3c684-eedd-4e1b-b298-b67ace56da50" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Deleting offline snapshot 86d3c684-eedd-4e1b-b298-b67ace56da50 of volume 379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] snapshot_file for this snap is: volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cb9893-350a-49a5-9267-c7209f5a8e60]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:41 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 Sep 28 12:21:41 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:41 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50" returned: 0 in 0.824s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-379a5ba3-238c-4450-b486-311a79cff2dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:21:41 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6352340-d8bb-4efd-96db-fe627a035b8b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:41 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc Sep 28 12:21:41 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:42 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc" returned: 0 in 0.520s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dc8429-921c-42a6-972c-34b05cf13e95]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:42 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 Sep 28 12:21:42 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:42 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511" returned: 0 in 0.508s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-379a5ba3-238c-4450-b486-311a79cff2dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:21:43 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cad91d-c369-42cf-9aee-c69419d248ee]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:43 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 Sep 28 12:21:43 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:43 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50" returned: 0 in 0.442s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-379a5ba3-238c-4450-b486-311a79cff2dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:21:43 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed7386b-0a56-4b5e-bfab-f8b7ab9fcce7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:43 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc Sep 28 12:21:43 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:44 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc" returned: 0 in 0.675s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:44 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 Sep 28 12:21:44 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:44 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50" returned: 0 in 0.482s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:44 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50 Sep 28 12:21:44 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:44 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.86d3c684-eedd-4e1b-b298-b67ace56da50" returned: 0 in 0.319s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a5ba3-238c-4450-b486-311a79cff2dc /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 -F qcow2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:44 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a5ba3-238c-4450-b486-311a79cff2dc /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 -F qcow2 Sep 28 12:21:44 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:45 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-379a5ba3-238c-4450-b486-311a79cff2dc /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 -F qcow2" returned: 0 in 0.514s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-86d3c684-eedd-4e1b-b298-b67ace56da50" released by "_delete_snapshot" :: held 4.628s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-379a5ba3-238c-4450-b486-311a79cff2dc" released by "delete_snapshot" :: held 4.662s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=66,cinder:INSERT=20,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=57,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=14 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Created reservations ['94661e58-d3dd-4953-96f6-73bfa9c2572d', '225062c8-54fd-4c71-aad1-d0bf0a89f478', '3825bd62-1dcd-4d51-b258-5f2728cab8c9', '2615b5e1-c82f-4023-bf23-c22684081a0b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Delete snapshot completed successfully. Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-86d3c684-eedd-4e1b-b298-b67ace56da50-delete_snapshot" released by "delete_snapshot" :: held 4.983s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-d30bbca8-0bb8-4b89-81ee-adbeb29bd511-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-d30bbca8-0bb8-4b89-81ee-adbeb29bd511-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-379a5ba3-238c-4450-b486-311a79cff2dc" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-379a5ba3-238c-4450-b486-311a79cff2dc" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-d30bbca8-0bb8-4b89-81ee-adbeb29bd511" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-d30bbca8-0bb8-4b89-81ee-adbeb29bd511" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Deleting offline snapshot d30bbca8-0bb8-4b89-81ee-adbeb29bd511 of volume 379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:21:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] snapshot_file for this snap is: volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:21:46 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[60793235-647e-479d-a030-ca949171be51]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:46 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 Sep 28 12:21:46 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:46 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511" returned: 0 in 0.922s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-379a5ba3-238c-4450-b486-311a79cff2dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:21:47 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c0ec0b-6420-4871-a78e-954e97fe6f9f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:47 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc Sep 28 12:21:47 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:47 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc" returned: 0 in 0.880s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:47 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 Sep 28 12:21:47 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:48 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511" returned: 0 in 0.586s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:48 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511 Sep 28 12:21:48 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:48 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc.d30bbca8-0bb8-4b89-81ee-adbeb29bd511" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-d30bbca8-0bb8-4b89-81ee-adbeb29bd511" released by "_delete_snapshot" :: held 2.944s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-379a5ba3-238c-4450-b486-311a79cff2dc" released by "delete_snapshot" :: held 2.978s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:48 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Created reservations ['a7bcb667-c47b-41f8-a157-c40eb22fa5ea', 'd06d9e70-8000-42f8-96f9-4ac4e1bbe33b', '0888e532-5539-4138-9771-4d5e22d5f6f4', '0c6a10e5-8196-459e-b4e6-dea4b7572800'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Delete snapshot completed successfully. Sep 28 12:21:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-d30bbca8-0bb8-4b89-81ee-adbeb29bd511-delete_snapshot" released by "delete_snapshot" :: held 3.259s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Snapshots deleted, issuing volume delete {{(pid=87048) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 12:21:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-379a5ba3-238c-4450-b486-311a79cff2dc" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-379a5ba3-238c-4450-b486-311a79cff2dc" acquired by "delete_volume" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[02468762-bb4f-4adc-a95f-ad86ecb90643]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:49 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc Sep 28 12:21:49 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:49 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc" returned: 0 in 0.573s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:49 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc Sep 28 12:21:49 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:50 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-379a5ba3-238c-4450-b486-311a79cff2dc" returned: 0 in 0.481s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-379a5ba3-238c-4450-b486-311a79cff2dc" released by "delete_volume" :: held 1.193s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:50 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Created reservations ['c6724d1c-e8b3-47e5-a957-656c0f8f412c', '390d232e-db73-46c8-a0ad-83856379caa9', 'f6ab0193-e132-4792-9fd0-b672a878bafa', 'a98034f0-2f8e-47c8-84fa-d27b3de759d2'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:50 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:21:50 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:51 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.462s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Deleted volume successfully. Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34dc95df-76e7-4b00-94f4-f71ceeea9b22 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-379a5ba3-238c-4450-b486-311a79cff2dc-delete_volume" released by "delete_volume" :: held 10.488s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Acquiring lock "cinder-0768f2c5-88c1-481e-abb1-8ba08fdf109b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Lock "cinder-0768f2c5-88c1-481e-abb1-8ba08fdf109b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Acquiring lock "cinder-quobyte-0768f2c5-88c1-481e-abb1-8ba08fdf109b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Lock "cinder-quobyte-0768f2c5-88c1-481e-abb1-8ba08fdf109b" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f91fb19-a285-40cd-9fd6-59f4ef731a75]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:51 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b Sep 28 12:21:51 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:51 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Flow 'volume_create_manager' (0bdfd3c3-ca42-426c-a187-3abfebe89f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c51b1e-4fa9-488c-b0c3-7eef1efb32e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15c51b1e-4fa9-488c-b0c3-7eef1efb32e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1867755883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d149631f-7216-4917-b11b-98a509b1f917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a09c7ae42dd42b0936a544dd58cfecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:52Z,use_quota=True,user_id='e3c7a31f10024c02b50570c971867cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe6414f-301f-4235-8b40-9f6a67f9ba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fe6414f-301f-4235-8b40-9f6a67f9ba1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801f5fec-2c72-4fe0-b74f-c00006a399de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (801f5fec-2c72-4fe0-b74f-c00006a399de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd149631f-7216-4917-b11b-98a509b1f917', 'volume_name': 'volume-d149631f-7216-4917-b11b-98a509b1f917', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c2e8e7-2ff1-40ec-98a1-57c3cae28b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c2e8e7-2ff1-40ec-98a1-57c3cae28b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189ef332-c3d0-4f55-97db-f0f88d94853f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:52 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Volume d149631f-7216-4917-b11b-98a509b1f917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d149631f-7216-4917-b11b-98a509b1f917', 'volume_size': 1} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1867755883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d149631f-7216-4917-b11b-98a509b1f917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a09c7ae42dd42b0936a544dd58cfecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:52Z,use_quota=True,user_id='e3c7a31f10024c02b50570c971867cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Creating volume d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:52 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:52 devstack sudo[98161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 1073741824 Sep 28 12:21:52 devstack sudo[98161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:52 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b" returned: 0 in 0.442s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:52 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b Sep 28 12:21:52 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:52 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0768f2c5-88c1-481e-abb1-8ba08fdf109b" returned: 0 in 0.348s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Lock "cinder-quobyte-0768f2c5-88c1-481e-abb1-8ba08fdf109b" released by "delete_volume" :: held 0.855s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Created reservations ['63195a11-b44c-4124-bec2-07a8c5852b22', '3641a23d-b346-4cef-8087-2365e61f3879', '43280f15-20d6-4963-a02a-323081e716a1', 'fd4de992-1943-432e-a555-850f00a2cf91'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:52 devstack sudo[98161]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 1073741824" returned: 0 in 0.644s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:52 devstack sudo[98173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 Sep 28 12:21:52 devstack sudo[98173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:52 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:21:52 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:53 devstack sudo[98173]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917" returned: 0 in 0.324s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189ef332-c3d0-4f55-97db-f0f88d94853f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d149631f-7216-4917-b11b-98a509b1f917', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ed948c-f35c-4801-8c02-5db554366b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:53 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Volume volume-d149631f-7216-4917-b11b-98a509b1f917 (d149631f-7216-4917-b11b-98a509b1f917): created successfully Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ed948c-f35c-4801-8c02-5db554366b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Flow 'volume_create_manager' (0bdfd3c3-ca42-426c-a187-3abfebe89f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:53 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-82f31e17-1b1f-4ff3-b78c-a1a98683ca2a tempest-VolumesDeleteCascade-859832742 None] Created volume successfully. Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.403s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Deleted volume successfully. Sep 28 12:21:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-159908a2-238b-480a-abf8-23518abd0d48 tempest-VolumesNegativeTest-828308420 None] Lock "cinder-0768f2c5-88c1-481e-abb1-8ba08fdf109b-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Acquiring lock "cinder-dcba68a9-b298-438d-8f45-992ba2e09f7f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "cinder-dcba68a9-b298-438d-8f45-992ba2e09f7f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Acquiring lock "cinder-quobyte-dcba68a9-b298-438d-8f45-992ba2e09f7f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "cinder-quobyte-dcba68a9-b298-438d-8f45-992ba2e09f7f" acquired by "delete_volume" :: waited 0.051s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba43f222-5e49-473f-b7ae-6a28476fb09f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Creating offline snapshot b05993e5-196c-4eb0-8f45-82f1619687f4 of volume d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eba899b-0600-44bf-bdb8-68da419bb81a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:54 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f Sep 28 12:21:54 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:54 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 Sep 28 12:21:54 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:54 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f" returned: 0 in 0.532s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:55 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f Sep 28 12:21:55 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:55 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917" returned: 0 in 0.543s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:55 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 1G Sep 28 12:21:55 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:55 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dcba68a9-b298-438d-8f45-992ba2e09f7f" returned: 0 in 0.422s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "cinder-quobyte-dcba68a9-b298-438d-8f45-992ba2e09f7f" released by "delete_volume" :: held 1.076s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Created reservations ['ea7aeec3-54f7-45c3-8472-23d73cc28a83', '1cf17deb-f7ae-4afe-a995-e9891afdc88f', 'a1c6f1fb-fe57-484f-a0b1-5f6281da90bf', 'f2024c69-d391-4c99-86e4-b7cd6ef18fd3'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:55 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:21:55 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:55 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 1G" returned: 0 in 0.611s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d149631f-7216-4917-b11b-98a509b1f917 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:55 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d149631f-7216-4917-b11b-98a509b1f917 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 Sep 28 12:21:55 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:55 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.290s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:55 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:21:55 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Deleted volume successfully. Sep 28 12:21:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-150d2f95-4b21-4777-8125-c3820abf4367 tempest-AttachVolumeShelveTestJSON-1571735433 None] Lock "cinder-dcba68a9-b298-438d-8f45-992ba2e09f7f-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:21:56 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d149631f-7216-4917-b11b-98a509b1f917 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4" returned: 0 in 0.368s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:56 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 is being set with open permissions: ugo+rw Sep 28 12:21:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:56 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 Sep 28 12:21:56 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:56 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4" returned: 0 in 0.329s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:56 devstack sudo[98213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.info Sep 28 12:21:56 devstack sudo[98213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:56 devstack sudo[98213]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.info" returned: 0 in 0.357s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:56 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.info is being set with open permissions: ugo+rw Sep 28 12:21:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:56 devstack sudo[98218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.info Sep 28 12:21:56 devstack sudo[98218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:57 devstack sudo[98218]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.info" returned: 0 in 0.331s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.707s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:57 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e40d306f-c63a-4c4d-ba4f-2b9445e0a587 tempest-VolumesDeleteCascade-859832742 None] Create snapshot completed successfully Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Flow 'volume_create_manager' (a5567ec0-c3d4-4d1e-ac7a-39f853ba6e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4b3f06-eb74-45fe-af84-209869ec84fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e4b3f06-eb74-45fe-af84-209869ec84fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-683779171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd79a6f-56af-489d-a000-cdc30b13dd09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a09c7ae42dd42b0936a544dd58cfecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b05993e5-196c-4eb0-8f45-82f1619687f4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:21:58Z,use_quota=True,user_id='e3c7a31f10024c02b50570c971867cc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54e9acb-ebe1-4b94-8ddb-3316f184506d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54e9acb-ebe1-4b94-8ddb-3316f184506d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152fee6d-a763-477e-86d2-42f29801494c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (152fee6d-a763-477e-86d2-42f29801494c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dfd79a6f-56af-489d-a000-cdc30b13dd09', 'volume_name': 'volume-dfd79a6f-56af-489d-a000-cdc30b13dd09', 'volume_size': 1, 'snapshot_id': 'b05993e5-196c-4eb0-8f45-82f1619687f4'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0ee0f4-3772-4ef7-9545-2ad69d61be45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0ee0f4-3772-4ef7-9545-2ad69d61be45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b96f05-8b07-484c-abec-66106625b708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:21:58 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Volume dfd79a6f-56af-489d-a000-cdc30b13dd09: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dfd79a6f-56af-489d-a000-cdc30b13dd09', 'volume_size': 1, 'snapshot_id': 'b05993e5-196c-4eb0-8f45-82f1619687f4'} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-b05993e5-196c-4eb0-8f45-82f1619687f4-dfd79a6f-56af-489d-a000-cdc30b13dd09" by "_create_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-b05993e5-196c-4eb0-8f45-82f1619687f4-dfd79a6f-56af-489d-a000-cdc30b13dd09" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Creating volume dfd79a6f-56af-489d-a000-cdc30b13dd09 from snapshot b05993e5-196c-4eb0-8f45-82f1619687f4 {{(pid=87048) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-dfd79a6f-56af-489d-a000-cdc30b13dd09" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-dfd79a6f-56af-489d-a000-cdc30b13dd09" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] snapshot: b05993e5-196c-4eb0-8f45-82f1619687f4, volume: dfd79a6f-56af-489d-a000-cdc30b13dd09, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fac166-494e-426c-b170-fbaf90674b80]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:58 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 Sep 28 12:21:58 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:59 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4" returned: 0 in 0.500s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d149631f-7216-4917-b11b-98a509b1f917(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:21:59 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[907d463b-2ea9-4e7c-aba9-8111788187e6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:21:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:59 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 Sep 28 12:21:59 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:21:59 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 28 12:21:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917" returned: 0 in 0.449s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:21:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:21:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:21:59 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:21:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:21:59 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 Sep 28 12:21:59 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:08 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=28,cinder:INSERT=12,cinder:UPDATE=39,cinder:DELETE=3 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:22:08 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:INSERT=10,cinder:UPDATE=40,cinder:SELECT=32,cinder:DELETE=2 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:22:09 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09" returned: 0 in 9.447s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917, size 1024.00 MB, duration 9.45 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:22:09 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Converted 1024.00 MB image at 108.39 MB/s Sep 28 12:22:09 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 is being set with open permissions: ugo+rw Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:09 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 Sep 28 12:22:09 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:09 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09" returned: 0 in 0.381s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-dfd79a6f-56af-489d-a000-cdc30b13dd09" released by "_copy_volume_from_snapshot" :: held 10.911s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-b05993e5-196c-4eb0-8f45-82f1619687f4-dfd79a6f-56af-489d-a000-cdc30b13dd09" released by "_create_volume_from_snapshot" :: held 11.038s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.061s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b96f05-8b07-484c-abec-66106625b708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd79a6f-56af-489d-a000-cdc30b13dd09', 'volume_size': 1, 'snapshot_id': 'b05993e5-196c-4eb0-8f45-82f1619687f4'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d69648b-6e15-4b8f-8fb4-ba8db171fc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:09 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Volume volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 (dfd79a6f-56af-489d-a000-cdc30b13dd09): created successfully Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d69648b-6e15-4b8f-8fb4-ba8db171fc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Flow 'volume_create_manager' (a5567ec0-c3d4-4d1e-ac7a-39f853ba6e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:09 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-981f0874-9c9b-4b71-a605-dd6365cb5607 tempest-VolumesDeleteCascade-859832742 None] Created volume successfully. Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-d149631f-7216-4917-b11b-98a509b1f917-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-d149631f-7216-4917-b11b-98a509b1f917-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Performing cascade delete. {{(pid=87048) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-b05993e5-196c-4eb0-8f45-82f1619687f4-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-b05993e5-196c-4eb0-8f45-82f1619687f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-d149631f-7216-4917-b11b-98a509b1f917" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-d149631f-7216-4917-b11b-98a509b1f917" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-b05993e5-196c-4eb0-8f45-82f1619687f4" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-b05993e5-196c-4eb0-8f45-82f1619687f4" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Deleting offline snapshot b05993e5-196c-4eb0-8f45-82f1619687f4 of volume d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] snapshot_file for this snap is: volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d0b042-3d9f-43b9-9f59-96a919fb52f6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:11 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 Sep 28 12:22:11 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:12 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4" returned: 0 in 0.740s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d149631f-7216-4917-b11b-98a509b1f917(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:22:12 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a291a2a-4837-4d65-8a68-b744523ca601]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:12 devstack sudo[98382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 Sep 28 12:22:12 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:12 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917" returned: 0 in 0.669s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:12 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 Sep 28 12:22:12 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:13 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4" returned: 0 in 0.753s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:13 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4 Sep 28 12:22:13 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:14 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917.b05993e5-196c-4eb0-8f45-82f1619687f4" returned: 0 in 0.491s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-b05993e5-196c-4eb0-8f45-82f1619687f4" released by "_delete_snapshot" :: held 2.863s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-d149631f-7216-4917-b11b-98a509b1f917" released by "delete_snapshot" :: held 2.898s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Created reservations ['c14a4257-c615-4763-a4de-a817eb5f5413', '3e76a531-3d35-4631-a731-0349cb9689d3', 'cc8be256-90f1-4154-bc93-89cd775d9df3', 'cb2ea0dd-badd-4450-9383-f9e6383a1b0e'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:14 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Delete snapshot completed successfully. Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-b05993e5-196c-4eb0-8f45-82f1619687f4-delete_snapshot" released by "delete_snapshot" :: held 3.181s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Snapshots deleted, issuing volume delete {{(pid=87048) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-d149631f-7216-4917-b11b-98a509b1f917" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-d149631f-7216-4917-b11b-98a509b1f917" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c467e-6864-406f-8c68-1d28d6d1f1e5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:14 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 Sep 28 12:22:14 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:15 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917" returned: 0 in 0.697s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:15 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917 Sep 28 12:22:15 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:15 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d149631f-7216-4917-b11b-98a509b1f917" returned: 0 in 0.417s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-d149631f-7216-4917-b11b-98a509b1f917" released by "delete_volume" :: held 1.246s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Created reservations ['7ce6d88a-276f-43f4-b3a1-fadda2c9dfea', '19ac899d-d91a-4754-bcc7-b97ddc6167f1', '8fbbe9c6-a2b5-4b2b-ac78-c0e9a39e10ba', '984fd0e5-c09a-4afe-afb9-0f69a91a14f7'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:15 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:22:15 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:16 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.402s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:16 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Deleted volume successfully. Sep 28 12:22:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f7ea26cb-5284-49a2-959c-f2e87aa7dcce tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-d149631f-7216-4917-b11b-98a509b1f917-delete_volume" released by "delete_volume" :: held 5.185s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-dfd79a6f-56af-489d-a000-cdc30b13dd09-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-dfd79a6f-56af-489d-a000-cdc30b13dd09-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "cinder-quobyte-dfd79a6f-56af-489d-a000-cdc30b13dd09" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-dfd79a6f-56af-489d-a000-cdc30b13dd09" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:17 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc24e2bd-b07e-468f-9f5e-47952ce2a01f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:17 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 Sep 28 12:22:17 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:17 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09" returned: 0 in 0.641s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:17 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09 Sep 28 12:22:17 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:18 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dfd79a6f-56af-489d-a000-cdc30b13dd09" returned: 0 in 0.383s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-quobyte-dfd79a6f-56af-489d-a000-cdc30b13dd09" released by "delete_volume" :: held 1.094s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Created reservations ['fbe37b13-9256-49ed-b9e8-753121c7128e', '51e6a298-e8c6-465d-8b55-a18833a91e08', 'cec12558-66d4-4289-aec7-ee7c0c206bb4', 'eff6d9d7-c4a6-47e1-8426-47a37ff80dec'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:18 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:22:18 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:18 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.359s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:18 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Deleted volume successfully. Sep 28 12:22:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-375c568d-eb92-4b64-8745-ad9d7d8aa708 tempest-VolumesDeleteCascade-859832742 None] Lock "cinder-dfd79a6f-56af-489d-a000-cdc30b13dd09-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:28 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=24,cinder:SELECT=15,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:22:28 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Flow 'volume_create_manager' (448f8e25-ef2c-43b4-b8ee-51853cdd2d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df568b7f-b84c-411e-a442-d785e306ca93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df568b7f-b84c-411e-a442-d785e306ca93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2009040735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f5a6f3-c534-47b4-ad2e-986f327796e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f2bc51640a48119f8edd91f5a15bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:31Z,use_quota=True,user_id='a4aa8d8e740a4b3db6d738ec09815b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a94f413-4b1c-49dd-9e1b-3f0601b220df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a94f413-4b1c-49dd-9e1b-3f0601b220df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2595d8-d6fb-4eab-a776-5c765c31a437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a2595d8-d6fb-4eab-a776-5c765c31a437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f5a6f3-c534-47b4-ad2e-986f327796e8', 'volume_name': 'volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91444c05-e019-4ac5-bf2f-062c6be7d786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91444c05-e019-4ac5-bf2f-062c6be7d786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e689f4-2cab-4955-93f7-3a039a81be04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:31 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Volume a2f5a6f3-c534-47b4-ad2e-986f327796e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8', 'volume_size': 1} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2009040735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f5a6f3-c534-47b4-ad2e-986f327796e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f2bc51640a48119f8edd91f5a15bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:31Z,use_quota=True,user_id='a4aa8d8e740a4b3db6d738ec09815b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Creating volume a2f5a6f3-c534-47b4-ad2e-986f327796e8 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:31 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:22:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:31 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 1073741824 Sep 28 12:22:31 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:32 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 1073741824" returned: 0 in 0.905s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:32 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 Sep 28 12:22:32 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:33 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8" returned: 0 in 0.480s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] <== create_volume: return (1488ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e689f4-2cab-4955-93f7-3a039a81be04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bc26fc-3042-4767-ae74-5ea32c25ac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:33 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Volume volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 (a2f5a6f3-c534-47b4-ad2e-986f327796e8): created successfully Sep 28 12:22:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bc26fc-3042-4767-ae74-5ea32c25ac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Flow 'volume_create_manager' (448f8e25-ef2c-43b4-b8ee-51853cdd2d42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-019e89ed-56ec-4a91-824b-ac8bc876ff20 tempest-VolumesTransfersTest-1074528148 None] Created volume successfully. Sep 28 12:22:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-75161da7-8f70-44dc-a24e-5c7f92f16058 tempest-VolumesTransfersTest-688334984 None] Transfer volume completed successfully. Sep 28 12:22:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Acquiring lock "cinder-a2f5a6f3-c534-47b4-ad2e-986f327796e8-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Lock "cinder-a2f5a6f3-c534-47b4-ad2e-986f327796e8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Acquiring lock "cinder-quobyte-a2f5a6f3-c534-47b4-ad2e-986f327796e8" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Lock "cinder-quobyte-a2f5a6f3-c534-47b4-ad2e-986f327796e8" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:35 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d367328-5b71-4383-b712-5b94654d3f78]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:35 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 Sep 28 12:22:35 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:36 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8" returned: 0 in 0.484s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:36 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8 Sep 28 12:22:36 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:36 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2f5a6f3-c534-47b4-ad2e-986f327796e8" returned: 0 in 0.298s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Lock "cinder-quobyte-a2f5a6f3-c534-47b4-ad2e-986f327796e8" released by "delete_volume" :: held 0.887s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Created reservations ['004abb0a-6921-4f5e-b68a-0ec0b76a2295', '69ccd805-0306-4f4e-a412-553a9c3e3f88', '31c57b9b-d626-498d-abef-ddb4f959b598', 'b342b351-8b0f-4724-90a8-7d1cfd837073'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:36 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:22:36 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:37 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.357s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:37 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Deleted volume successfully. Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-527e17bf-191b-4b72-8a12-843d47db6703 tempest-VolumesTransfersTest-635900201 None] Lock "cinder-a2f5a6f3-c534-47b4-ad2e-986f327796e8-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Flow 'volume_create_manager' (6e759813-b954-4de9-9ceb-da5b5ea58378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e842de8f-3dba-4527-840f-3a2535a0a8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e842de8f-3dba-4527-840f-3a2535a0a8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1764205265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffc0a9c-5c23-4680-8e43-947daccb0e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f2bc51640a48119f8edd91f5a15bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:37Z,use_quota=True,user_id='a4aa8d8e740a4b3db6d738ec09815b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe642f1-7f4c-4757-b5e0-2e890db4ad19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe642f1-7f4c-4757-b5e0-2e890db4ad19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0862aa7-fbb7-405b-826c-3c5333b234bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0862aa7-fbb7-405b-826c-3c5333b234bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ffc0a9c-5c23-4680-8e43-947daccb0e68', 'volume_name': 'volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c82a13c-6ed0-4d18-b94a-b4eef5f8faba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c82a13c-6ed0-4d18-b94a-b4eef5f8faba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b1fcf5-33c3-4097-a01d-b4292b02c3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:37 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Volume 9ffc0a9c-5c23-4680-8e43-947daccb0e68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68', 'volume_size': 1} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1764205265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffc0a9c-5c23-4680-8e43-947daccb0e68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31f2bc51640a48119f8edd91f5a15bba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:37Z,use_quota=True,user_id='a4aa8d8e740a4b3db6d738ec09815b3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Creating volume 9ffc0a9c-5c23-4680-8e43-947daccb0e68 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:37 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:22:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:37 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 1073741824 Sep 28 12:22:37 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:38 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:22:38 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:38 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 1073741824" returned: 0 in 0.694s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Flow 'volume_create_manager' (2cacfcf3-cdae-4f53-93e3-356fb2c6f4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733a3c1c-2965-425c-aa93-700c18c2add0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (733a3c1c-2965-425c-aa93-700c18c2add0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1059938308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94793cb-6531-44cb-b491-8e4e850e54d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a16339ad9f949e49301c22affbdd489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:38Z,use_quota=True,user_id='fa0a49d10bbd4cd8acc1410c018ffbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:38 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 Sep 28 12:22:38 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793e5994-8f38-41eb-98f9-844b9156050f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793e5994-8f38-41eb-98f9-844b9156050f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc6336c-c7ae-49b4-a0b9-fc604fecaec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:22:38 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.367s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:22:38 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68" returned: 0 in 0.534s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38b1fcf5-33c3-4097-a01d-b4292b02c3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c959d89-4f5e-476d-9e4e-5ea657086eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:38 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Volume volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 (9ffc0a9c-5c23-4680-8e43-947daccb0e68): created successfully Sep 28 12:22:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c959d89-4f5e-476d-9e4e-5ea657086eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Flow 'volume_create_manager' (6e759813-b954-4de9-9ceb-da5b5ea58378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-05090359-de55-4dc8-8669-73260169e5e7 tempest-VolumesTransfersTest-1074528148 None] Created volume successfully. Sep 28 12:22:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc6336c-c7ae-49b4-a0b9-fc604fecaec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b94793cb-6531-44cb-b491-8e4e850e54d8', 'volume_name': 'volume-b94793cb-6531-44cb-b491-8e4e850e54d8', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e4e4e5-f8c7-450c-908b-24df786c7ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e4e4e5-f8c7-450c-908b-24df786c7ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8d4475-1005-4a5e-818d-0163addb096b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:39 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Volume b94793cb-6531-44cb-b491-8e4e850e54d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b94793cb-6531-44cb-b491-8e4e850e54d8', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 12:22:39 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Trying to clone b94793cb-6531-44cb-b491-8e4e850e54d8 from image d446342e-1c65-4f57-97fb-ae62bc9167ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:22:40 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Image download 20.69 MB at 20.69 MB/s Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8a8c44-37be-4813-a3e4-bcc52bd68968]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:40 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD Sep 28 12:22:40 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Acquiring lock "cinder-9ffc0a9c-5c23-4680-8e43-947daccb0e68-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Lock "cinder-9ffc0a9c-5c23-4680-8e43-947daccb0e68-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Acquiring lock "cinder-quobyte-9ffc0a9c-5c23-4680-8e43-947daccb0e68" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:40 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Lock "cinder-quobyte-9ffc0a9c-5c23-4680-8e43-947daccb0e68" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef is fetched for user fa0a49d10bbd4cd8acc1410c018ffbaa. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e91226-d817-46d1-b353-1c8a6689a12f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[658021b0-bbe9-4993-aac6-1d777050264f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:40 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 Sep 28 12:22:40 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:41 devstack sudo[98576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD Sep 28 12:22:41 devstack sudo[98576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:41 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68" returned: 0 in 0.590s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:41 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68 Sep 28 12:22:41 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:41 devstack sudo[98576]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD" returned: 0 in 0.688s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1059938308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94793cb-6531-44cb-b491-8e4e850e54d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a16339ad9f949e49301c22affbdd489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:38Z,use_quota=True,user_id='fa0a49d10bbd4cd8acc1410c018ffbaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Creating volume b94793cb-6531-44cb-b491-8e4e850e54d8 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:41 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:41 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 1073741824 Sep 28 12:22:41 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:41 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ffc0a9c-5c23-4680-8e43-947daccb0e68" returned: 0 in 0.440s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Lock "cinder-quobyte-9ffc0a9c-5c23-4680-8e43-947daccb0e68" released by "delete_volume" :: held 1.129s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:41 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Created reservations ['2b7edeac-0881-4eb9-9edf-a6ffcc9e2528', '9ee8907b-7acc-4e7a-99f4-f6f1963974ad', 'e631dcf6-8807-47b8-82f9-5d4d34503db2', 'f038fa7b-18c1-4b99-b452-5a778fe90dcb'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:42 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:22:42 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:42 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 1073741824" returned: 0 in 0.904s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:42 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.485s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:42 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 Sep 28 12:22:42 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:42 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Deleted volume successfully. Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20ae4c10-b18b-4168-9991-e08a2246455d tempest-VolumesTransfersTest-635900201 None] Lock "cinder-9ffc0a9c-5c23-4680-8e43-947daccb0e68-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:42 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8" returned: 0 in 0.468s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] <== create_volume: return (1443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:42 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Attempting download of d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume b94793cb-6531-44cb-b491-8e4e850e54d8. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:22:43 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6da59e5-88ea-4bfb-8b27-adfc11c7bcec]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_4wbgcmpn {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:43 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_4wbgcmpn Sep 28 12:22:43 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:43 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_4wbgcmpn" returned: 0 in 0.472s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_4wbgcmpn {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:43 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_4wbgcmpn Sep 28 12:22:43 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-5c078378-23e5-475a-927f-84869012fe15 req-38590305-4648-4ade-95aa-ed7cdc2166be tempest-TestMinimumBasicScenario-1033946683 None] Terminate volume connection completed successfully. Sep 28 12:22:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-5c078378-23e5-475a-927f-84869012fe15 req-38590305-4648-4ade-95aa-ed7cdc2166be tempest-TestMinimumBasicScenario-1033946683 None] Deleting attachment fc8fd70f-888a-48d4-8825-22b753ee7ca9. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:22:44 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_4wbgcmpn" returned: 1 in 0.593s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d446342e-1c65-4f57-97fb-ae62bc9167ef_4wbgcmpn' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0aa9a3-72f6-4317-b387-7e1dd1352bc7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:44 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD Sep 28 12:22:44 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:44 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] d446342e-1c65-4f57-97fb-ae62bc9167ef was qcow2, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Acquiring lock "cinder-28f10b3c-bea1-43d1-836e-127ac7fb3d9f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:44 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 Sep 28 12:22:44 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Lock "cinder-28f10b3c-bea1-43d1-836e-127ac7fb3d9f-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Acquiring lock "cinder-quobyte-28f10b3c-bea1-43d1-836e-127ac7fb3d9f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Lock "cinder-quobyte-28f10b3c-bea1-43d1-836e-127ac7fb3d9f" acquired by "delete_volume" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3dd8bd-60ff-49d6-950a-a560894b9254]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:22:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:45 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f Sep 28 12:22:45 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:45 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f" returned: 0 in 0.708s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:45 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f Sep 28 12:22:45 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:46 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-28f10b3c-bea1-43d1-836e-127ac7fb3d9f" returned: 0 in 0.419s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Lock "cinder-quobyte-28f10b3c-bea1-43d1-836e-127ac7fb3d9f" released by "delete_volume" :: held 1.262s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Created reservations ['ec7af9a2-ff5a-407c-8109-6ca2b5bfc646', 'ca2a3dad-e265-4f6d-b709-aa9ddafdc55b', 'c8f0534d-9c05-42de-8491-6a871ce6d14f', 'e909f1c5-a6ec-421c-bd5d-edcfbb72af26'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:46 devstack sudo[98643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:22:46 devstack sudo[98643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:46 devstack sudo[98643]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.411s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:22:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Deleted volume successfully. Sep 28 12:22:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3f214ab7-06be-4eaf-8391-480987868e4e tempest-TestMinimumBasicScenario-1033946683 None] Lock "cinder-28f10b3c-bea1-43d1-836e-127ac7fb3d9f-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:22:47 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8" returned: 0 in 3.144s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:47 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d446342e-1c65-4f57-97fb-ae62bc9167ef_qtdwnvjodevstack@QuobyteHD, size 112.00 MB, duration 3.15 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:22:47 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Converted 112.00 MB image at 35.61 MB/s Sep 28 12:22:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:47 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 1G Sep 28 12:22:47 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:48 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 1G" returned: 0 in 0.686s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Downloaded image d446342e-1c65-4f57-97fb-ae62bc9167ef ((None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}])) to volume b94793cb-6531-44cb-b491-8e4e850e54d8 successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Temporary image d446342e-1c65-4f57-97fb-ae62bc9167ef for user fa0a49d10bbd4cd8acc1410c018ffbaa is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Marking volume b94793cb-6531-44cb-b491-8e4e850e54d8 as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Copying metadata from image d446342e-1c65-4f57-97fb-ae62bc9167ef to b94793cb-6531-44cb-b491-8e4e850e54d8. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Creating volume glance metadata for volume b94793cb-6531-44cb-b491-8e4e850e54d8 backed by image d446342e-1c65-4f57-97fb-ae62bc9167ef with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8d4475-1005-4a5e-818d-0163addb096b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94793cb-6531-44cb-b491-8e4e850e54d8', 'volume_size': 1, 'image_id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d446342e-1c65-4f57-97fb-ae62bc9167ef', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd4d41fc7910442ea92a9e31e4e21ea72', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd446342e-1c65-4f57-97fb-ae62bc9167ef', 'created_at': datetime.datetime(2026, 9, 28, 10, 6, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 6, 25, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d446342e-1c65-4f57-97fb-ae62bc9167ef/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4e91d0-c721-4c95-be4e-9733298e5647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:48 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Volume volume-b94793cb-6531-44cb-b491-8e4e850e54d8 (b94793cb-6531-44cb-b491-8e4e850e54d8): created successfully Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c4e91d0-c721-4c95-be4e-9733298e5647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Flow 'volume_create_manager' (2cacfcf3-cdae-4f53-93e3-356fb2c6f4db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-51aa26e8-f12d-4101-bef2-957a44f54fc2 tempest-TestShelveInstance-279810442 None] Created volume successfully. Sep 28 12:22:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-d610663b-4259-4a99-931c-c94f2a0f0916 req-c291089e-897b-4d0a-a45d-ec7349be5764 tempest-TestShelveInstance-279810442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-d610663b-4259-4a99-931c-c94f2a0f0916 req-c291089e-897b-4d0a-a45d-ec7349be5764 tempest-TestShelveInstance-279810442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-d610663b-4259-4a99-931c-c94f2a0f0916 req-c291089e-897b-4d0a-a45d-ec7349be5764 tempest-TestShelveInstance-279810442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-d610663b-4259-4a99-931c-c94f2a0f0916 req-c291089e-897b-4d0a-a45d-ec7349be5764 tempest-TestShelveInstance-279810442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-b94793cb-6531-44cb-b491-8e4e850e54d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbca9bad-30b4-4efd-b7cf-f102644d2760', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:22:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-d610663b-4259-4a99-931c-c94f2a0f0916 req-c291089e-897b-4d0a-a45d-ec7349be5764 tempest-TestShelveInstance-279810442 None] attachment_update completed successfully. Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Flow 'volume_create_manager' (3648dfd7-3214-4010-8124-a0456e844341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd41241b-e183-45a7-bbd0-d15e67f2d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd41241b-e183-45a7-bbd0-d15e67f2d030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1480980965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1228a55f-4115-4a81-a9e2-5a4b540631da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46343bc0c26e43dfab7153e4480fccea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:56Z,use_quota=True,user_id='7723fb1be1a44cfcb86f8ad935ea3a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a599bd-38da-457b-a3d7-fe07eb19176d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3a599bd-38da-457b-a3d7-fe07eb19176d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03273b-a968-42fd-a63d-e5ebce6bde33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03273b-a968-42fd-a63d-e5ebce6bde33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1228a55f-4115-4a81-a9e2-5a4b540631da', 'volume_name': 'volume-1228a55f-4115-4a81-a9e2-5a4b540631da', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77326eb5-9803-4830-860e-05c60f507460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77326eb5-9803-4830-860e-05c60f507460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1ecc3f-2cac-4f11-8e21-d90aa1773770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:56 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Volume 1228a55f-4115-4a81-a9e2-5a4b540631da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1228a55f-4115-4a81-a9e2-5a4b540631da', 'volume_size': 1} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:22:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1480980965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1228a55f-4115-4a81-a9e2-5a4b540631da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46343bc0c26e43dfab7153e4480fccea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:22:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:22:56Z,use_quota=True,user_id='7723fb1be1a44cfcb86f8ad935ea3a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Creating volume 1228a55f-4115-4a81-a9e2-5a4b540631da {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:22:56 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:56 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da 1073741824 Sep 28 12:22:56 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:56 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da 1073741824" returned: 0 in 0.644s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:22:57 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da Sep 28 12:22:57 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:22:57 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Sep 28 12:22:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da" returned: 0 in 0.273s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:22:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:22:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:22:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1ecc3f-2cac-4f11-8e21-d90aa1773770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1228a55f-4115-4a81-a9e2-5a4b540631da', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9055846-6f76-427e-a372-d87b6a07275c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:22:57 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Volume volume-1228a55f-4115-4a81-a9e2-5a4b540631da (1228a55f-4115-4a81-a9e2-5a4b540631da): created successfully Sep 28 12:22:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9055846-6f76-427e-a372-d87b6a07275c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:22:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Flow 'volume_create_manager' (3648dfd7-3214-4010-8124-a0456e844341) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:22:57 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5d29b9f8-ee45-4c06-873e-68c20dbcf1be tempest-VolumesTransfersV355Test-935378970 None] Created volume successfully. Sep 28 12:22:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0235a621-8874-45e1-ba97-e7c2b8d2214f tempest-VolumesTransfersV355Test-248979625 None] Transfer volume completed successfully. Sep 28 12:23:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Acquiring lock "cinder-1228a55f-4115-4a81-a9e2-5a4b540631da-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Lock "cinder-1228a55f-4115-4a81-a9e2-5a4b540631da-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Acquiring lock "cinder-quobyte-1228a55f-4115-4a81-a9e2-5a4b540631da" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Lock "cinder-quobyte-1228a55f-4115-4a81-a9e2-5a4b540631da" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aba70c-878c-4555-98d1-a47ea34ec15c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:23:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:00 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da Sep 28 12:23:00 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:00 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da" returned: 0 in 0.473s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:00 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da Sep 28 12:23:00 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:01 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1228a55f-4115-4a81-a9e2-5a4b540631da" returned: 0 in 0.462s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Lock "cinder-quobyte-1228a55f-4115-4a81-a9e2-5a4b540631da" released by "delete_volume" :: held 1.013s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Created reservations ['20d93196-b8dd-46d3-b668-288de83c9f1b', '7bc88f40-e29c-43c9-8909-eb430365aaf0', '646861be-c1f2-4486-9a01-51e660ba7237', '59450adf-9691-4e98-8096-ac2d8de92da3'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:01 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:23:01 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:01 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.347s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:23:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Deleted volume successfully. Sep 28 12:23:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-664281c9-1407-4b48-bec7-ccbb47f55d4d tempest-VolumesTransfersV355Test-86916288 None] Lock "cinder-1228a55f-4115-4a81-a9e2-5a4b540631da-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Flow 'volume_create_manager' (8ab8e622-152b-4a6e-a7ce-a7431a8477d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50c25be-eea9-4186-8df7-c7c7318f616f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50c25be-eea9-4186-8df7-c7c7318f616f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1088909821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973d22ca-16b5-495d-93e0-76fe47fc80d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46343bc0c26e43dfab7153e4480fccea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:03Z,use_quota=True,user_id='7723fb1be1a44cfcb86f8ad935ea3a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550f29b2-499a-4847-afab-de8db67bd775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550f29b2-499a-4847-afab-de8db67bd775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d49aea3-d16a-4e7d-a461-702794775efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d49aea3-d16a-4e7d-a461-702794775efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '973d22ca-16b5-495d-93e0-76fe47fc80d2', 'volume_name': 'volume-973d22ca-16b5-495d-93e0-76fe47fc80d2', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0eddd3e-1cd1-4019-8897-0cae3cdefe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0eddd3e-1cd1-4019-8897-0cae3cdefe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d996acb1-17db-4d28-861a-4dd9a2cdebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:03 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Volume 973d22ca-16b5-495d-93e0-76fe47fc80d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-973d22ca-16b5-495d-93e0-76fe47fc80d2', 'volume_size': 1} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1088909821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973d22ca-16b5-495d-93e0-76fe47fc80d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46343bc0c26e43dfab7153e4480fccea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:03Z,use_quota=True,user_id='7723fb1be1a44cfcb86f8ad935ea3a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Creating volume 973d22ca-16b5-495d-93e0-76fe47fc80d2 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:23:03 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:23:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:03 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 1073741824 Sep 28 12:23:03 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:05 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 1073741824" returned: 0 in 1.212s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:05 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 Sep 28 12:23:05 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:05 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2" returned: 0 in 0.527s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:23:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.878s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d996acb1-17db-4d28-861a-4dd9a2cdebe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-973d22ca-16b5-495d-93e0-76fe47fc80d2', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bea1db-93ea-4782-9f20-a5bcd696da0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Volume volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 (973d22ca-16b5-495d-93e0-76fe47fc80d2): created successfully Sep 28 12:23:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02bea1db-93ea-4782-9f20-a5bcd696da0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Flow 'volume_create_manager' (8ab8e622-152b-4a6e-a7ce-a7431a8477d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:05 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-cf574390-ab9f-4c47-8455-4a29875ce443 tempest-VolumesTransfersV355Test-935378970 None] Created volume successfully. Sep 28 12:23:06 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Flow 'volume_create_manager' (04ccbe79-e7f3-452f-9b09-32a775cdbe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116c0709-a189-44b3-a3c3-181d73005f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (116c0709-a189-44b3-a3c3-181d73005f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1070653499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01145387-dc4e-44b3-934f-9c10a6472408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d27c27660a4b338816e43f4f999ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:07Z,use_quota=True,user_id='65e807ac14464319b2d795652288940e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a5bfa5-0c7c-4207-bcf4-9d8e196caeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10a5bfa5-0c7c-4207-bcf4-9d8e196caeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ea8fec-049e-4bf5-9cbe-bcfb5deed967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ea8fec-049e-4bf5-9cbe-bcfb5deed967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01145387-dc4e-44b3-934f-9c10a6472408', 'volume_name': 'volume-01145387-dc4e-44b3-934f-9c10a6472408', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc97060-a1a2-4d19-9655-c5dbe6b0424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fc97060-a1a2-4d19-9655-c5dbe6b0424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f213f459-42d9-4883-845c-4fd8aff2f3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:07 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Volume 01145387-dc4e-44b3-934f-9c10a6472408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01145387-dc4e-44b3-934f-9c10a6472408', 'volume_size': 1} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1070653499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01145387-dc4e-44b3-934f-9c10a6472408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d27c27660a4b338816e43f4f999ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:07Z,use_quota=True,user_id='65e807ac14464319b2d795652288940e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Creating volume 01145387-dc4e-44b3-934f-9c10a6472408 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:23:07 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:07 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408 1073741824 Sep 28 12:23:07 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Acquiring lock "cinder-973d22ca-16b5-495d-93e0-76fe47fc80d2-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Lock "cinder-973d22ca-16b5-495d-93e0-76fe47fc80d2-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Acquiring lock "cinder-quobyte-973d22ca-16b5-495d-93e0-76fe47fc80d2" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Lock "cinder-quobyte-973d22ca-16b5-495d-93e0-76fe47fc80d2" acquired by "delete_volume" :: waited 0.037s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6958de-6f20-4458-8b6d-decf314a9afb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:23:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:08 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 Sep 28 12:23:08 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:08 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408 1073741824" returned: 0 in 1.262s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:08 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408 Sep 28 12:23:08 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:08 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2" returned: 0 in 0.988s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:09 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2 Sep 28 12:23:09 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:09 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408" returned: 0 in 0.503s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.889s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f213f459-42d9-4883-845c-4fd8aff2f3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01145387-dc4e-44b3-934f-9c10a6472408', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8877037b-1919-45da-9696-4a3b88afebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:09 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Volume volume-01145387-dc4e-44b3-934f-9c10a6472408 (01145387-dc4e-44b3-934f-9c10a6472408): created successfully Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8877037b-1919-45da-9696-4a3b88afebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Flow 'volume_create_manager' (04ccbe79-e7f3-452f-9b09-32a775cdbe17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:09 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0052a5c2-6522-4f49-b621-320006f472c6 tempest-AttachVolumeNegativeTest-1520821419 None] Created volume successfully. Sep 28 12:23:09 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-973d22ca-16b5-495d-93e0-76fe47fc80d2" returned: 0 in 0.454s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Lock "cinder-quobyte-973d22ca-16b5-495d-93e0-76fe47fc80d2" released by "delete_volume" :: held 1.516s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Created reservations ['88c42d56-1d1b-4b8d-be51-9ca7fdd812a0', '9c41a4dd-ca83-483e-9da3-0abf4ce6df58', '9125f742-0a4a-40c0-b2d9-89cb88578e82', '63ac98f4-58ed-40fc-bf0d-26989d3c16ff'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:09 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:23:09 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:10 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.405s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:10 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:23:10 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Deleted volume successfully. Sep 28 12:23:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d1d80cf-0291-48ec-a010-99a8428f32a0 tempest-VolumesTransfersV355Test-86916288 None] Lock "cinder-973d22ca-16b5-495d-93e0-76fe47fc80d2-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:23:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-6d118d59-b6e6-46db-95c1-df1f58c0fce6 req-1cc08b2c-d789-4829-ac4e-de6966cd6cf9 tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-6d118d59-b6e6-46db-95c1-df1f58c0fce6 req-1cc08b2c-d789-4829-ac4e-de6966cd6cf9 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-6d118d59-b6e6-46db-95c1-df1f58c0fce6 req-1cc08b2c-d789-4829-ac4e-de6966cd6cf9 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-6d118d59-b6e6-46db-95c1-df1f58c0fce6 req-1cc08b2c-d789-4829-ac4e-de6966cd6cf9 tempest-AttachVolumeNegativeTest-1520821419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-01145387-dc4e-44b3-934f-9c10a6472408', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9632de9f-7f07-4f79-8b9e-a32ba414dee1', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:23:11 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-6d118d59-b6e6-46db-95c1-df1f58c0fce6 req-1cc08b2c-d789-4829-ac4e-de6966cd6cf9 tempest-AttachVolumeNegativeTest-1520821419 None] attachment_update completed successfully. Sep 28 12:23:21 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=65,cinder:INSERT=18,cinder:UPDATE=59,cinder:DELETE=7 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:23:21 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=67,cinder:DELETE=4,cinder:SELECT=55,cinder:INSERT=21 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:38 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:23:38 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:38 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.445s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:23:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:23:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-f57dfc8c-15fa-44a6-a565-c873eb4015a9 req-ebe43b1d-7c0f-40a0-b5fb-5100bd39e711 tempest-TestShelveInstance-279810442 None] Terminate volume connection completed successfully. Sep 28 12:23:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-f57dfc8c-15fa-44a6-a565-c873eb4015a9 req-ebe43b1d-7c0f-40a0-b5fb-5100bd39e711 tempest-TestShelveInstance-279810442 None] Deleting attachment bbca9bad-30b4-4efd-b7cf-f102644d2760. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:23:54 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:23:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Flow 'volume_create_manager' (9732fdd2-9e72-43f2-8e8a-312fd4f751ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0b18a6-8e10-4501-90e0-99a5d3b79631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0b18a6-8e10-4501-90e0-99a5d3b79631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1240176558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bcc586-7878-4eb8-968f-8d764f5cc2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3664c7e61046669953b7d1ff7b0e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:55Z,use_quota=True,user_id='b4a82199c4d04e7ab584241563b942c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e262fbb3-5bb3-4039-a977-65159ad2085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e262fbb3-5bb3-4039-a977-65159ad2085a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f11d1d2-ce0a-45a6-9513-f682cff12aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f11d1d2-ce0a-45a6-9513-f682cff12aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20bcc586-7878-4eb8-968f-8d764f5cc2a6', 'volume_name': 'volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d43c48e-87ec-42e4-94d6-f815ca320569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d43c48e-87ec-42e4-94d6-f815ca320569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897d7c15-e7b3-4ce6-a8fd-772b93904319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Volume 20bcc586-7878-4eb8-968f-8d764f5cc2a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6', 'volume_size': 1} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1240176558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20bcc586-7878-4eb8-968f-8d764f5cc2a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3664c7e61046669953b7d1ff7b0e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:55Z,use_quota=True,user_id='b4a82199c4d04e7ab584241563b942c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Creating volume 20bcc586-7878-4eb8-968f-8d764f5cc2a6 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:23:55 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:55 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 1073741824 Sep 28 12:23:55 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Flow 'volume_create_manager' (e1cfa542-6d2c-4935-9c9f-9947bdb8de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46838d6-54d9-4aab-8aa4-e3f6ca10ea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f46838d6-54d9-4aab-8aa4-e3f6ca10ea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-354784469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c76eaf-aa22-419c-95bf-a6c1a81b7263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3664c7e61046669953b7d1ff7b0e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:55Z,use_quota=True,user_id='b4a82199c4d04e7ab584241563b942c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fe15d9-4b98-407a-8b8f-588405434a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fe15d9-4b98-407a-8b8f-588405434a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33209434-3c40-4900-983b-579aa1db656a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33209434-3c40-4900-983b-579aa1db656a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c76eaf-aa22-419c-95bf-a6c1a81b7263', 'volume_name': 'volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb15545-11a2-42e8-93e7-20a67f370671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfb15545-11a2-42e8-93e7-20a67f370671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55cc9a3-4c89-4834-9af0-41f3b125a987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:55 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Volume 25c76eaf-aa22-419c-95bf-a6c1a81b7263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263', 'volume_size': 1} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-3ddddb86-8f68-441c-9654-c40a648677a3 req-76ac49b3-291e-4d41-9a4c-90da2a16fad2 tempest-TestShelveInstance-279810442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:55 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 1073741824" returned: 0 in 0.894s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:56 devstack sudo[99543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 Sep 28 12:23:56 devstack sudo[99543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:56 devstack sudo[99543]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6" returned: 0 in 0.395s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:23:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-354784469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25c76eaf-aa22-419c-95bf-a6c1a81b7263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef3664c7e61046669953b7d1ff7b0e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:23:55Z,use_quota=True,user_id='b4a82199c4d04e7ab584241563b942c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Creating volume 25c76eaf-aa22-419c-95bf-a6c1a81b7263 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:23:56 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:56 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 1073741824 Sep 28 12:23:56 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (897d7c15-e7b3-4ce6-a8fd-772b93904319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107ea15f-0629-4812-91f5-fae5dc1839b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:56 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Volume volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 (20bcc586-7878-4eb8-968f-8d764f5cc2a6): created successfully Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (107ea15f-0629-4812-91f5-fae5dc1839b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Flow 'volume_create_manager' (9732fdd2-9e72-43f2-8e8a-312fd4f751ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:56 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1efb14a7-bcfd-4c76-b290-73c42ac69ed8 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Created volume successfully. Sep 28 12:23:57 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 1073741824" returned: 0 in 0.838s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:23:57 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 Sep 28 12:23:57 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:23:57 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263" returned: 0 in 0.467s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-3ddddb86-8f68-441c-9654-c40a648677a3 req-76ac49b3-291e-4d41-9a4c-90da2a16fad2 tempest-TestShelveInstance-279810442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.949s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-3ddddb86-8f68-441c-9654-c40a648677a3 req-76ac49b3-291e-4d41-9a4c-90da2a16fad2 tempest-TestShelveInstance-279810442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e55cc9a3-4c89-4834-9af0-41f3b125a987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f43979c-6e67-4449-b5ef-83052cbaf74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:23:57 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Volume volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 (25c76eaf-aa22-419c-95bf-a6c1a81b7263): created successfully Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f43979c-6e67-4449-b5ef-83052cbaf74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Flow 'volume_create_manager' (e1cfa542-6d2c-4935-9c9f-9947bdb8de8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:23:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-3ddddb86-8f68-441c-9654-c40a648677a3 req-76ac49b3-291e-4d41-9a4c-90da2a16fad2 tempest-TestShelveInstance-279810442 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-b94793cb-6531-44cb-b491-8e4e850e54d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e98b720-8f14-4f0b-867c-2a26ea04189b', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:23:57 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-92f8a29a-f1b3-4180-b08c-72f66f6c5509 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Created volume successfully. Sep 28 12:23:58 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-3ddddb86-8f68-441c-9654-c40a648677a3 req-76ac49b3-291e-4d41-9a4c-90da2a16fad2 tempest-TestShelveInstance-279810442 None] attachment_update completed successfully. Sep 28 12:24:07 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=11,cinder:UPDATE=7,cinder:DELETE=2 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:24:08 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:24:09 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-87ad8f4d-0d99-402c-b62e-cd31ba5b0859 req-053929f4-bff9-4371-8f3c-3017f96f51e9 tempest-AttachVolumeNegativeTest-1520821419 None] Terminate volume connection completed successfully. Sep 28 12:24:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-87ad8f4d-0d99-402c-b62e-cd31ba5b0859 req-053929f4-bff9-4371-8f3c-3017f96f51e9 tempest-AttachVolumeNegativeTest-1520821419 None] Deleting attachment 9632de9f-7f07-4f79-8b9e-a32ba414dee1. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:24:19 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=1 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:24:19 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=1 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:24:35 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Flow 'volume_create_manager' (69f61579-19f4-41d5-873d-ede43834772c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904e0387-35c3-4875-b115-51e2c3952b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (904e0387-35c3-4875-b115-51e2c3952b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-382078152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0174427d-ab77-48bb-af6d-1cc234bcbaa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7f4e65ba4084b489d1e3180bfa3927a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:36Z,use_quota=True,user_id='d393c424c20a4bcaae6510cec8751ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911fffb3-6a49-4685-b89b-65f2088ed53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911fffb3-6a49-4685-b89b-65f2088ed53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbba54a7-0583-4925-b4a5-07420cf2a4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbba54a7-0583-4925-b4a5-07420cf2a4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0174427d-ab77-48bb-af6d-1cc234bcbaa4', 'volume_name': 'volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bfb520-a778-47a7-b16c-1e42d711f3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8bfb520-a778-47a7-b16c-1e42d711f3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8352e57-3751-48be-b980-217f7c8c5ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:36 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Volume 0174427d-ab77-48bb-af6d-1cc234bcbaa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4', 'volume_size': 1} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-382078152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0174427d-ab77-48bb-af6d-1cc234bcbaa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7f4e65ba4084b489d1e3180bfa3927a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:24:36Z,use_quota=True,user_id='d393c424c20a4bcaae6510cec8751ce6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Creating volume 0174427d-ab77-48bb-af6d-1cc234bcbaa4 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:24:36 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:36 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 1073741824 Sep 28 12:24:36 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:36 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 1073741824" returned: 0 in 0.689s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:36 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 Sep 28 12:24:36 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:37 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4" returned: 0 in 0.436s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] <== create_volume: return (1197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:24:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8352e57-3751-48be-b980-217f7c8c5ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c444ce-417a-47ec-bbba-81a99ec38953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:37 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Volume volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 (0174427d-ab77-48bb-af6d-1cc234bcbaa4): created successfully Sep 28 12:24:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c444ce-417a-47ec-bbba-81a99ec38953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Flow 'volume_create_manager' (69f61579-19f4-41d5-873d-ede43834772c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:37 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2eb81628-2282-4568-996d-ecbb2e97346d tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Created volume successfully. Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:38 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:24:38 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:38 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.292s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-b6e79de4-ef6b-476c-b4d4-f25075ab2c4c req-9f410fc5-ab0f-4b6b-9eff-42c192f5245c tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-b6e79de4-ef6b-476c-b4d4-f25075ab2c4c req-9f410fc5-ab0f-4b6b-9eff-42c192f5245c tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-b6e79de4-ef6b-476c-b4d4-f25075ab2c4c req-9f410fc5-ab0f-4b6b-9eff-42c192f5245c tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-b6e79de4-ef6b-476c-b4d4-f25075ab2c4c req-9f410fc5-ab0f-4b6b-9eff-42c192f5245c tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c818bffc-34f4-4258-92e4-9dfaff7c0e3a', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:24:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-b6e79de4-ef6b-476c-b4d4-f25075ab2c4c req-9f410fc5-ab0f-4b6b-9eff-42c192f5245c tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] attachment_update completed successfully. Sep 28 12:24:41 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-a5a15ac8-8760-4697-a460-f5362bc81568 req-b9fc62cd-7c4a-4f73-b618-54c9e8af6090 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Terminate volume connection completed successfully. Sep 28 12:24:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-a5a15ac8-8760-4697-a460-f5362bc81568 req-b9fc62cd-7c4a-4f73-b618-54c9e8af6090 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Deleting attachment c818bffc-34f4-4258-92e4-9dfaff7c0e3a. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Acquiring lock "cinder-0174427d-ab77-48bb-af6d-1cc234bcbaa4-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "cinder-0174427d-ab77-48bb-af6d-1cc234bcbaa4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Acquiring lock "cinder-quobyte-0174427d-ab77-48bb-af6d-1cc234bcbaa4" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "cinder-quobyte-0174427d-ab77-48bb-af6d-1cc234bcbaa4" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[45299fa7-13e2-4fa4-bfcc-df0ad3b0ac9e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:42 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 Sep 28 12:24:42 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:42 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4" returned: 0 in 0.396s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:42 devstack sudo[100160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4 Sep 28 12:24:42 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:42 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0174427d-ab77-48bb-af6d-1cc234bcbaa4" returned: 0 in 0.259s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "cinder-quobyte-0174427d-ab77-48bb-af6d-1cc234bcbaa4" released by "delete_volume" :: held 0.711s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Created reservations ['448f94e2-38b5-4250-9f5d-30b7a5edf1fe', '34a23abc-68a1-49c4-9444-9f910cbfe526', '55d2bf8d-6def-407b-b6e4-19c89bb31482', '9e6c2571-b68e-4b58-9926-545aa8dac415'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:43 devstack sudo[100163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:24:43 devstack sudo[100163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:43 devstack sudo[100163]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.302s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:43 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Deleted volume successfully. Sep 28 12:24:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-addd01fd-147d-4783-9ae8-bf9b2d6f46a8 tempest-TestServerVolumeAttachScenarioOldVersion-1842736354 None] Lock "cinder-0174427d-ab77-48bb-af6d-1cc234bcbaa4-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9a4bfa74-ea72-41c7-a454-3a965e66d663 req-940a8754-4207-48cb-a815-da6011ed18d2 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9a4bfa74-ea72-41c7-a454-3a965e66d663 req-940a8754-4207-48cb-a815-da6011ed18d2 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9a4bfa74-ea72-41c7-a454-3a965e66d663 req-940a8754-4207-48cb-a815-da6011ed18d2 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-9a4bfa74-ea72-41c7-a454-3a965e66d663 req-940a8754-4207-48cb-a815-da6011ed18d2 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc763b74-1eda-45bd-9eb3-14018027b4fc', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:24:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-9a4bfa74-ea72-41c7-a454-3a965e66d663 req-940a8754-4207-48cb-a815-da6011ed18d2 tempest-TestServerVolumeAttachmentScenario-1742439023 None] attachment_update completed successfully. Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9e6efc25-7de0-458a-9757-a49103abb6d6 req-e5c07dc3-1718-41df-91f8-d2f2fdd3af68 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9e6efc25-7de0-458a-9757-a49103abb6d6 req-e5c07dc3-1718-41df-91f8-d2f2fdd3af68 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9e6efc25-7de0-458a-9757-a49103abb6d6 req-e5c07dc3-1718-41df-91f8-d2f2fdd3af68 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-9e6efc25-7de0-458a-9757-a49103abb6d6 req-e5c07dc3-1718-41df-91f8-d2f2fdd3af68 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0a7ec31-ec01-4e3a-addc-54aa8fc0599b', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:24:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-9e6efc25-7de0-458a-9757-a49103abb6d6 req-e5c07dc3-1718-41df-91f8-d2f2fdd3af68 tempest-TestServerVolumeAttachmentScenario-1742439023 None] attachment_update completed successfully. Sep 28 12:24:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-66db1d4e-7cb0-4939-83cf-7e47704cbcfd tempest-TestShelveInstance-279810442 None] Terminate volume connection completed successfully. Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-66db1d4e-7cb0-4939-83cf-7e47704cbcfd tempest-TestShelveInstance-279810442 None] Deleting attachment 2e98b720-8f14-4f0b-867c-2a26ea04189b. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Acquiring lock "cinder-b94793cb-6531-44cb-b491-8e4e850e54d8-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Lock "cinder-b94793cb-6531-44cb-b491-8e4e850e54d8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Acquiring lock "cinder-quobyte-b94793cb-6531-44cb-b491-8e4e850e54d8" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Lock "cinder-quobyte-b94793cb-6531-44cb-b491-8e4e850e54d8" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[deef044f-9c4e-4518-82e3-56b08d738c85]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:24:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:51 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 Sep 28 12:24:51 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:52 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8" returned: 0 in 0.624s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:52 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8 Sep 28 12:24:52 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:52 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b94793cb-6531-44cb-b491-8e4e850e54d8" returned: 0 in 0.294s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Lock "cinder-quobyte-b94793cb-6531-44cb-b491-8e4e850e54d8" released by "delete_volume" :: held 0.983s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG cinder.quota [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Created reservations ['c686984f-87d6-4e29-ab92-c46c1fb59409', '6fd77a7e-0c79-46fe-9b68-0c0ba5e0c7af', '303a0f10-7b0c-477f-9abb-f89b97ace1a0', 'ae69d022-9dc6-49f5-8ea6-a399501806db'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:24:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:24:52 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:24:52 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:24:52 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Sep 28 12:24:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.265s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:24:53 devstack cinder-volume[87048]: DEBUG cinder.manager [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:24:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Deleted volume successfully. Sep 28 12:24:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-5429973a-ecca-4e9c-b07a-9beb9b522100 req-836d1aae-6285-4797-8171-6374fadd2bd4 tempest-TestShelveInstance-279810442 None] Lock "cinder-b94793cb-6531-44cb-b491-8e4e850e54d8-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:24:54 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-1076c46e-2d72-4ba7-94dc-340ddd62d4c5 req-f64fbc75-a414-42cb-aa27-b2373f996e96 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Terminate volume connection completed successfully. Sep 28 12:24:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-1076c46e-2d72-4ba7-94dc-340ddd62d4c5 req-f64fbc75-a414-42cb-aa27-b2373f996e96 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Deleting attachment f0a7ec31-ec01-4e3a-addc-54aa8fc0599b. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:24:55 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-fc774be3-3087-4715-b350-bc849de9faf6 req-2d8e1db6-5d6c-42cd-bcce-9a52bd2f78b1 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Terminate volume connection completed successfully. Sep 28 12:24:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-fc774be3-3087-4715-b350-bc849de9faf6 req-2d8e1db6-5d6c-42cd-bcce-9a52bd2f78b1 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Deleting attachment fc763b74-1eda-45bd-9eb3-14018027b4fc. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:24:59 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:24:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Flow 'volume_create_manager' (0ac7013c-68d0-4fda-9375-7db9e4f12096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:24:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296f3f41-e5a7-4783-b438-7004b5105fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296f3f41-e5a7-4783-b438-7004b5105fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1193938797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753cdd32-40e4-46f6-81f0-a9571eb6d138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d27c27660a4b338816e43f4f999ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:00Z,use_quota=True,user_id='65e807ac14464319b2d795652288940e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49c7211-6f05-4ddc-9725-79991e48f4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49c7211-6f05-4ddc-9725-79991e48f4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:24:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5e038d-e671-431d-a136-ca0cff344446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:24:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5e038d-e671-431d-a136-ca0cff344446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '753cdd32-40e4-46f6-81f0-a9571eb6d138', 'volume_name': 'volume-753cdd32-40e4-46f6-81f0-a9571eb6d138', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00b188f-1ccd-47d3-bf83-c0cfb75dbf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00b188f-1ccd-47d3-bf83-c0cfb75dbf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de034911-d68e-4cfe-a6fd-dba9b4a88d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:00 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Volume 753cdd32-40e4-46f6-81f0-a9571eb6d138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-753cdd32-40e4-46f6-81f0-a9571eb6d138', 'volume_size': 1} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1193938797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=753cdd32-40e4-46f6-81f0-a9571eb6d138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d27c27660a4b338816e43f4f999ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:00Z,use_quota=True,user_id='65e807ac14464319b2d795652288940e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Creating volume 753cdd32-40e4-46f6-81f0-a9571eb6d138 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:00 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:00 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 1073741824 Sep 28 12:25:00 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:00 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 1073741824" returned: 0 in 0.835s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:00 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 Sep 28 12:25:00 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:01 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138" returned: 0 in 0.350s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de034911-d68e-4cfe-a6fd-dba9b4a88d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-753cdd32-40e4-46f6-81f0-a9571eb6d138', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7be8318-c301-4e1b-be2b-f5da1812d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:01 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Volume volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 (753cdd32-40e4-46f6-81f0-a9571eb6d138): created successfully Sep 28 12:25:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7be8318-c301-4e1b-be2b-f5da1812d716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Flow 'volume_create_manager' (0ac7013c-68d0-4fda-9375-7db9e4f12096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4be97c95-b2af-40f7-821f-705f32b37bfc tempest-AttachVolumeNegativeTest-1520821419 None] Created volume successfully. Sep 28 12:25:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "cinder-25c76eaf-aa22-419c-95bf-a6c1a81b7263-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "cinder-25c76eaf-aa22-419c-95bf-a6c1a81b7263-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "cinder-quobyte-25c76eaf-aa22-419c-95bf-a6c1a81b7263" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "cinder-quobyte-25c76eaf-aa22-419c-95bf-a6c1a81b7263" acquired by "delete_volume" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:02 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0138360-2986-4817-be66-c61e685ba32c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:02 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 Sep 28 12:25:02 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:02 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263" returned: 0 in 0.511s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:02 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263 Sep 28 12:25:02 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:03 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-25c76eaf-aa22-419c-95bf-a6c1a81b7263" returned: 0 in 0.327s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "cinder-quobyte-25c76eaf-aa22-419c-95bf-a6c1a81b7263" released by "delete_volume" :: held 0.906s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Created reservations ['fba1a212-f916-48ce-a13b-1db6ece71334', 'b77b7d4e-ec95-4513-8e7f-6351870ce842', 'f6c30858-0d32-4c1f-962f-cee90b8be3ea', '47759081-61f7-40c8-b310-7e5de18612ca'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-7c5d3b7d-85d0-433e-9999-d21e92f97e71 req-1c67a7f9-828e-42c8-b52f-23f7bedee1ee tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-7c5d3b7d-85d0-433e-9999-d21e92f97e71 req-1c67a7f9-828e-42c8-b52f-23f7bedee1ee tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-7c5d3b7d-85d0-433e-9999-d21e92f97e71 req-1c67a7f9-828e-42c8-b52f-23f7bedee1ee tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-7c5d3b7d-85d0-433e-9999-d21e92f97e71 req-1c67a7f9-828e-42c8-b52f-23f7bedee1ee tempest-AttachVolumeNegativeTest-1520821419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-753cdd32-40e4-46f6-81f0-a9571eb6d138', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'daa2ec58-4bd0-4415-baf5-10daad1bee4c', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "cinder-20bcc586-7878-4eb8-968f-8d764f5cc2a6-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:03 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:25:03 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "cinder-20bcc586-7878-4eb8-968f-8d764f5cc2a6-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "cinder-quobyte-20bcc586-7878-4eb8-968f-8d764f5cc2a6" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:03 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-7c5d3b7d-85d0-433e-9999-d21e92f97e71 req-1c67a7f9-828e-42c8-b52f-23f7bedee1ee tempest-AttachVolumeNegativeTest-1520821419 None] attachment_update completed successfully. Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "cinder-quobyte-20bcc586-7878-4eb8-968f-8d764f5cc2a6" acquired by "delete_volume" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab10f3a-a4d0-44fe-b706-6595c0643f92]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:03 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.473s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:03 devstack sudo[100739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 Sep 28 12:25:03 devstack sudo[100739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:03 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Deleted volume successfully. Sep 28 12:25:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-95775ebf-4218-4e44-b322-b8cdd94feedb tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "cinder-25c76eaf-aa22-419c-95bf-a6c1a81b7263-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:04 devstack sudo[100739]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6" returned: 0 in 0.590s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:04 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6 Sep 28 12:25:04 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:04 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20bcc586-7878-4eb8-968f-8d764f5cc2a6" returned: 0 in 0.418s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "cinder-quobyte-20bcc586-7878-4eb8-968f-8d764f5cc2a6" released by "delete_volume" :: held 1.096s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Created reservations ['5aaf349c-4d58-44bb-b8fa-82ff737133f0', '265d5b0f-7602-4654-a6e5-924aeaa9fd50', '192a82ad-97be-4b34-8353-e6bcd31b9e5b', '5044e153-aceb-409c-8546-8de1084c942a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:05 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:25:05 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:05 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.271s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:05 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:05 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Deleted volume successfully. Sep 28 12:25:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7594a622-2e1c-4512-820a-f452cf0ed145 tempest-TestServerVolumeAttachmentScenario-1742439023 None] Lock "cinder-20bcc586-7878-4eb8-968f-8d764f5cc2a6-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-a1417de6-75c1-4625-971a-99dfa7fbf44e req-57d7ca2b-27a1-4f46-bc15-86624fb106a3 tempest-AttachVolumeNegativeTest-1520821419 None] Terminate volume connection completed successfully. Sep 28 12:25:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-a1417de6-75c1-4625-971a-99dfa7fbf44e req-57d7ca2b-27a1-4f46-bc15-86624fb106a3 tempest-AttachVolumeNegativeTest-1520821419 None] Deleting attachment daa2ec58-4bd0-4415-baf5-10daad1bee4c. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (88f5eb49-3f5d-4e27-bb5c-fce12424699c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80b33e7-9fd3-4528-bc2c-771356d0ced7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c80b33e7-9fd3-4528-bc2c-771356d0ced7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841330201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b493df9-5f03-4b49-afda-ad04368f58dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:16Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef3217c-2577-43dc-8a55-12bb21220d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bef3217c-2577-43dc-8a55-12bb21220d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8301e7-1b85-42a6-8084-bfc22af23b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e8301e7-1b85-42a6-8084-bfc22af23b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b493df9-5f03-4b49-afda-ad04368f58dc', 'volume_name': 'volume-0b493df9-5f03-4b49-afda-ad04368f58dc', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc42f8a-bab5-4fc3-9155-60b666e54f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bc42f8a-bab5-4fc3-9155-60b666e54f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac6dab-485a-45c8-aca7-b6afcc83d713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:15 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume 0b493df9-5f03-4b49-afda-ad04368f58dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b493df9-5f03-4b49-afda-ad04368f58dc', 'volume_size': 1} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841330201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b493df9-5f03-4b49-afda-ad04368f58dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:16Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Creating volume 0b493df9-5f03-4b49-afda-ad04368f58dc {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:15 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:25:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:15 devstack sudo[101234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc 1073741824 Sep 28 12:25:15 devstack sudo[101234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:16 devstack sudo[101234]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc 1073741824" returned: 0 in 0.556s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:16 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc Sep 28 12:25:16 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:16 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc" returned: 0 in 0.332s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac6dab-485a-45c8-aca7-b6afcc83d713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b493df9-5f03-4b49-afda-ad04368f58dc', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9c6723-2e8b-4536-a02c-3b50b695c50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:16 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume volume-0b493df9-5f03-4b49-afda-ad04368f58dc (0b493df9-5f03-4b49-afda-ad04368f58dc): created successfully Sep 28 12:25:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9c6723-2e8b-4536-a02c-3b50b695c50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (88f5eb49-3f5d-4e27-bb5c-fce12424699c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f9b1a672-9254-4635-91d3-9ce346462ad1 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created volume successfully. Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (213e5f09-9f98-42a1-a0a8-9ac5978dd0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ed78db-6145-4e88-a2c1-84cfd5b13858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ed78db-6145-4e88-a2c1-84cfd5b13858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902663496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ded453-6d3d-475c-8b07-c242a538c5cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:18Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353f53ca-dbf0-43f9-91a9-dd7b88abe4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (353f53ca-dbf0-43f9-91a9-dd7b88abe4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c6e507-05a0-40a0-8ee2-9b605e0f10db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c6e507-05a0-40a0-8ee2-9b605e0f10db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ded453-6d3d-475c-8b07-c242a538c5cf', 'volume_name': 'volume-30ded453-6d3d-475c-8b07-c242a538c5cf', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2dfdc61-04d9-4382-bad3-6422afc717af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2dfdc61-04d9-4382-bad3-6422afc717af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bea0d92-7343-455d-94c8-41b259b45dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume 30ded453-6d3d-475c-8b07-c242a538c5cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ded453-6d3d-475c-8b07-c242a538c5cf', 'volume_size': 1} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1902663496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ded453-6d3d-475c-8b07-c242a538c5cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:18Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Creating volume 30ded453-6d3d-475c-8b07-c242a538c5cf {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:18 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:18 devstack sudo[101242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf 1073741824 Sep 28 12:25:18 devstack sudo[101242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (cc6bc46c-bf50-4336-8c0a-e4b23c85f6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5688e36b-72c1-48c5-bc7d-4e064b04e1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5688e36b-72c1-48c5-bc7d-4e064b04e1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1358293738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3028f109-80d0-4469-93e2-65bbb8a64131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:19Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5c8333-c2ca-4727-b8bd-566366c485a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5c8333-c2ca-4727-b8bd-566366c485a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e18e3b-afaa-4a8b-9996-9ba93989fab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37e18e3b-afaa-4a8b-9996-9ba93989fab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3028f109-80d0-4469-93e2-65bbb8a64131', 'volume_name': 'volume-3028f109-80d0-4469-93e2-65bbb8a64131', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ae06be-76ed-4ee1-9f0d-b8d1ef50612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ae06be-76ed-4ee1-9f0d-b8d1ef50612a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c66e6f-5d84-4187-a77f-54cde807311b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume 3028f109-80d0-4469-93e2-65bbb8a64131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3028f109-80d0-4469-93e2-65bbb8a64131', 'volume_size': 1} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:19 devstack sudo[101242]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf 1073741824" returned: 0 in 0.755s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:19 devstack sudo[101248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf Sep 28 12:25:19 devstack sudo[101248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (806cfdfe-724f-44c8-a563-5a725fa577e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a62fc8-26a9-4df1-bb34-c7dc0971d00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39a62fc8-26a9-4df1-bb34-c7dc0971d00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-901387427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a559f988-09f4-4256-aca2-ca9f9376383b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:19Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885ef63f-bb62-4cea-bebd-e978fe4b43d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (885ef63f-bb62-4cea-bebd-e978fe4b43d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d666f722-5c20-4623-a53a-42196ac59872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d666f722-5c20-4623-a53a-42196ac59872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a559f988-09f4-4256-aca2-ca9f9376383b', 'volume_name': 'volume-a559f988-09f4-4256-aca2-ca9f9376383b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00c40d9-ed27-44c7-b908-51212391d166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00c40d9-ed27-44c7-b908-51212391d166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecd8507-33e4-425d-b53d-e177a8f8b917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume a559f988-09f4-4256-aca2-ca9f9376383b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a559f988-09f4-4256-aca2-ca9f9376383b', 'volume_size': 1} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:19 devstack sudo[101248]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf" returned: 0 in 0.400s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1358293738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3028f109-80d0-4469-93e2-65bbb8a64131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:19Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Creating volume 3028f109-80d0-4469-93e2-65bbb8a64131 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:19 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:19 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131 1073741824 Sep 28 12:25:19 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bea0d92-7343-455d-94c8-41b259b45dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ded453-6d3d-475c-8b07-c242a538c5cf', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2f9590-df9b-469b-a11d-025c3ffdd19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume volume-30ded453-6d3d-475c-8b07-c242a538c5cf (30ded453-6d3d-475c-8b07-c242a538c5cf): created successfully Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d2f9590-df9b-469b-a11d-025c3ffdd19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (213e5f09-9f98-42a1-a0a8-9ac5978dd0d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:19 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f5656088-872d-4c28-b59a-0598008bc2da tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created volume successfully. Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (c82025d5-1de5-42ec-834e-0b2fdbab545b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5291340-8c7e-4c23-94a3-750f9ce559a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5291340-8c7e-4c23-94a3-750f9ce559a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-619506573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f4c190-8734-4851-a568-50f261fca09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:20Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c339c4-d265-4940-9de7-8444fc2e1b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59c339c4-d265-4940-9de7-8444fc2e1b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523c5d5b-53b1-4ab1-9f96-bb4d2a919a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523c5d5b-53b1-4ab1-9f96-bb4d2a919a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9f4c190-8734-4851-a568-50f261fca09b', 'volume_name': 'volume-c9f4c190-8734-4851-a568-50f261fca09b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01914f0-2143-4bff-8bb8-db2763ce9b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01914f0-2143-4bff-8bb8-db2763ce9b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68afb282-a8bb-4ffe-92e7-49014252335c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:20 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume c9f4c190-8734-4851-a568-50f261fca09b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9f4c190-8734-4851-a568-50f261fca09b', 'volume_size': 1} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:20 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131 1073741824" returned: 0 in 0.729s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (9f198864-5b2b-43a2-ac10-fecfbf144839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ef3aee-b10f-4eaf-a115-939c4f261530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ef3aee-b10f-4eaf-a115-939c4f261530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1923794570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b5681e-cb20-4e95-8c53-39095f79aa0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:20Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74901053-6197-4fd0-8301-053f8e96ea4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:20 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131 Sep 28 12:25:20 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74901053-6197-4fd0-8301-053f8e96ea4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d3d058-f21b-485d-948d-5c3b407fcf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d3d058-f21b-485d-948d-5c3b407fcf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b5681e-cb20-4e95-8c53-39095f79aa0b', 'volume_name': 'volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca79e92-377f-4d47-ab8f-7311918bc099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca79e92-377f-4d47-ab8f-7311918bc099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2076ec2-89a9-43d8-801d-243208eefa56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:20 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume d1b5681e-cb20-4e95-8c53-39095f79aa0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b', 'volume_size': 1} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:20 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131" returned: 0 in 0.334s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.540s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-901387427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a559f988-09f4-4256-aca2-ca9f9376383b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:19Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Creating volume a559f988-09f4-4256-aca2-ca9f9376383b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:20 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:25:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44c66e6f-5d84-4187-a77f-54cde807311b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3028f109-80d0-4469-93e2-65bbb8a64131', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4859f039-e593-4796-9e8d-8dd4541fab22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:21 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b 1073741824 Sep 28 12:25:21 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:21 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume volume-3028f109-80d0-4469-93e2-65bbb8a64131 (3028f109-80d0-4469-93e2-65bbb8a64131): created successfully Sep 28 12:25:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4859f039-e593-4796-9e8d-8dd4541fab22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:21 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (cc6bc46c-bf50-4336-8c0a-e4b23c85f6ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:21 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ae6f4e16-758e-4839-a70f-6458b9e807b6 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created volume successfully. Sep 28 12:25:21 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b 1073741824" returned: 0 in 0.881s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:21 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b Sep 28 12:25:21 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:22 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b" returned: 0 in 0.364s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.326s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.307s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-619506573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f4c190-8734-4851-a568-50f261fca09b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:20Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Creating volume c9f4c190-8734-4851-a568-50f261fca09b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:22 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aecd8507-33e4-425d-b53d-e177a8f8b917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a559f988-09f4-4256-aca2-ca9f9376383b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:22 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b 1073741824 Sep 28 12:25:22 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2690097b-2fee-4843-a3dc-950f8bbf3ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:22 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume volume-a559f988-09f4-4256-aca2-ca9f9376383b (a559f988-09f4-4256-aca2-ca9f9376383b): created successfully Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2690097b-2fee-4843-a3dc-950f8bbf3ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (806cfdfe-724f-44c8-a563-5a725fa577e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d9e9f841-95ba-4cec-bd1f-aec536169705 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created volume successfully. Sep 28 12:25:23 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b 1073741824" returned: 0 in 0.736s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:23 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b Sep 28 12:25:23 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:23 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b" returned: 0 in 0.345s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.733s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1923794570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b5681e-cb20-4e95-8c53-39095f79aa0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8305291164474ac38946e9409f706802',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:20Z,use_quota=True,user_id='a81b05ccd54c46eea6ee88ffb43616a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Creating volume d1b5681e-cb20-4e95-8c53-39095f79aa0b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:23 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:23 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b 1073741824 Sep 28 12:25:23 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68afb282-a8bb-4ffe-92e7-49014252335c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f4c190-8734-4851-a568-50f261fca09b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720b8755-b4f9-46ca-a7c3-5136d89a8e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:23 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume volume-c9f4c190-8734-4851-a568-50f261fca09b (c9f4c190-8734-4851-a568-50f261fca09b): created successfully Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720b8755-b4f9-46ca-a7c3-5136d89a8e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (c82025d5-1de5-42ec-834e-0b2fdbab545b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:23 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-bf472458-dbff-4dbf-86f5-cdfa9e8fd15d tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created volume successfully. Sep 28 12:25:24 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b 1073741824" returned: 0 in 0.688s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:24 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b Sep 28 12:25:24 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:24 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b" returned: 0 in 0.359s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2076ec2-89a9-43d8-801d-243208eefa56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d4a441-4c87-4b70-a41b-7b65226553ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:24 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Volume volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b (d1b5681e-cb20-4e95-8c53-39095f79aa0b): created successfully Sep 28 12:25:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95d4a441-4c87-4b70-a41b-7b65226553ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Flow 'volume_create_manager' (9f198864-5b2b-43a2-ac10-fecfbf144839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:24 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c13b68ca-348c-4a29-9757-c4dc79bae027 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created volume successfully. Sep 28 12:25:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-d1b5681e-cb20-4e95-8c53-39095f79aa0b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-d1b5681e-cb20-4e95-8c53-39095f79aa0b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-quobyte-d1b5681e-cb20-4e95-8c53-39095f79aa0b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-d1b5681e-cb20-4e95-8c53-39095f79aa0b" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1995a-cce1-4251-b7ad-63a0e3f977db]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:25 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b Sep 28 12:25:25 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:25 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b" returned: 0 in 0.485s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:25 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b Sep 28 12:25:25 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:26 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d1b5681e-cb20-4e95-8c53-39095f79aa0b" returned: 0 in 0.321s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-d1b5681e-cb20-4e95-8c53-39095f79aa0b" released by "delete_volume" :: held 0.888s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created reservations ['63a312a6-cc94-441b-9ea7-d40d574d10f5', '63146846-3739-423b-8adb-0aa107d29a3c', 'c90ec6c6-f4db-42d1-bf46-8a1bbdfc4221', '767da942-85c4-4aa0-97be-6c1a0ec3e80d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:26 devstack sudo[101301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:25:26 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-c9f4c190-8734-4851-a568-50f261fca09b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-c9f4c190-8734-4851-a568-50f261fca09b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-quobyte-c9f4c190-8734-4851-a568-50f261fca09b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-c9f4c190-8734-4851-a568-50f261fca09b" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d966fe-dca2-4518-bb94-93a905a7f4f7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:26 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b Sep 28 12:25:26 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:27 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.612s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Deleted volume successfully. Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d2f9d1b-b865-4f40-8c5c-e4c31afd99ac tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-d1b5681e-cb20-4e95-8c53-39095f79aa0b-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:27 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b" returned: 0 in 0.562s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:27 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b Sep 28 12:25:27 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:27 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c9f4c190-8734-4851-a568-50f261fca09b" returned: 0 in 0.340s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-c9f4c190-8734-4851-a568-50f261fca09b" released by "delete_volume" :: held 1.025s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created reservations ['ca7ae563-087a-421d-89da-273895d008a6', '857773c5-b0b4-417a-9cbb-9e9c6fefbb34', 'f61da765-484a-4658-9976-a8a9e8ea97b0', '01cf321d-b919-4e97-b816-b60f84d72494'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:27 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:25:27 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:28 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.334s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:28 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Deleted volume successfully. Sep 28 12:25:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f30dcf51-d089-409d-9dca-0fab5c874c44 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-c9f4c190-8734-4851-a568-50f261fca09b-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-a559f988-09f4-4256-aca2-ca9f9376383b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-a559f988-09f4-4256-aca2-ca9f9376383b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-quobyte-a559f988-09f4-4256-aca2-ca9f9376383b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-a559f988-09f4-4256-aca2-ca9f9376383b" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d6b336-e79d-4f63-ad5d-8deb8b1cbf55]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:29 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b Sep 28 12:25:29 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:29 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b" returned: 0 in 0.423s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:29 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b Sep 28 12:25:29 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:29 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a559f988-09f4-4256-aca2-ca9f9376383b" returned: 0 in 0.291s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-a559f988-09f4-4256-aca2-ca9f9376383b" released by "delete_volume" :: held 0.773s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created reservations ['dbd2a6cb-5be3-4e1d-9e08-a031b5e04431', '6dc2d95e-84a7-48af-8f90-a659b668b3cb', '22b306c6-df42-481b-a3d5-be142b1224b6', 'b49c993c-437f-4bda-a78e-72a513a35c8f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=82,cinder:UPDATE=87,cinder:DELETE=10,cinder:INSERT=21 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:30 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:25:30 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-3028f109-80d0-4469-93e2-65bbb8a64131-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-3028f109-80d0-4469-93e2-65bbb8a64131-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=84,cinder:UPDATE=86,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-quobyte-3028f109-80d0-4469-93e2-65bbb8a64131" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-3028f109-80d0-4469-93e2-65bbb8a64131" acquired by "delete_volume" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:30 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.327s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:30 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Deleted volume successfully. Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5b62e1-b9cc-4853-8c2f-b24d81b1e3cd]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a407b43f-9ed1-4276-9d8f-eb7cb48d9eee tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-a559f988-09f4-4256-aca2-ca9f9376383b-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:30 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131 Sep 28 12:25:30 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:30 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131" returned: 0 in 0.489s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:30 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131 Sep 28 12:25:30 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:31 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3028f109-80d0-4469-93e2-65bbb8a64131" returned: 0 in 0.297s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-3028f109-80d0-4469-93e2-65bbb8a64131" released by "delete_volume" :: held 0.863s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created reservations ['a6975de8-290c-4cdb-bcf2-eed3a8579042', '90f976c7-3df1-48b0-b05c-86542ed9f14b', '77d61c36-cad4-4081-a4ae-246f2e3946aa', '91b0553b-52e2-4bc0-b226-b2250057f410'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:31 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:25:31 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-30ded453-6d3d-475c-8b07-c242a538c5cf-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-30ded453-6d3d-475c-8b07-c242a538c5cf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-quobyte-30ded453-6d3d-475c-8b07-c242a538c5cf" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-30ded453-6d3d-475c-8b07-c242a538c5cf" acquired by "delete_volume" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1765c7-743a-4e91-affe-aa4c72bf1938]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:31 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.454s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:31 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Deleted volume successfully. Sep 28 12:25:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba0b2eeb-d1e5-439e-98dd-d7992a98c0e4 tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-3028f109-80d0-4469-93e2-65bbb8a64131-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:31 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf Sep 28 12:25:31 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:32 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf" returned: 0 in 0.459s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:32 devstack sudo[101361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf Sep 28 12:25:32 devstack sudo[101361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:32 devstack sudo[101361]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-30ded453-6d3d-475c-8b07-c242a538c5cf" returned: 0 in 0.350s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-30ded453-6d3d-475c-8b07-c242a538c5cf" released by "delete_volume" :: held 0.902s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created reservations ['c7cb11d6-84be-4367-8457-8577a4a32c83', 'dc4462e1-c08c-49d6-99f2-3beea3cc1e8c', 'ed359b7e-d298-4d62-ba8d-295a74f07fd9', 'bbc542a3-d710-411a-b344-7c95a1327f9d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:32 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:25:32 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:33 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.297s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:33 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Deleted volume successfully. Sep 28 12:25:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5d44a5cc-9ed3-4420-b05f-e744da7f7b2e tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-30ded453-6d3d-475c-8b07-c242a538c5cf-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-0b493df9-5f03-4b49-afda-ad04368f58dc-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-0b493df9-5f03-4b49-afda-ad04368f58dc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "cinder-quobyte-0b493df9-5f03-4b49-afda-ad04368f58dc" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:25:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-0b493df9-5f03-4b49-afda-ad04368f58dc" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:25:33 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[432e88f6-1476-47e1-ab81-a21152f0d392]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:25:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:34 devstack sudo[101367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc Sep 28 12:25:34 devstack sudo[101367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:34 devstack sudo[101367]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc" returned: 0 in 0.428s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:34 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc Sep 28 12:25:34 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:34 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b493df9-5f03-4b49-afda-ad04368f58dc" returned: 0 in 0.333s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-quobyte-0b493df9-5f03-4b49-afda-ad04368f58dc" released by "delete_volume" :: held 0.814s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Created reservations ['83ba2c12-9d8c-42d7-b5de-f84aa62d1f3f', 'c4cc11ad-0511-4527-833c-a46a8ed044f6', 'c7efa652-2121-4536-969d-2c44e5c29fdf', 'b51b8dda-064d-4d8c-b648-2d846b56bb17'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:34 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:25:34 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:35 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.347s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:35 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Deleted volume successfully. Sep 28 12:25:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-17954f73-a25e-4064-8427-7b06a6ea02ad tempest-CreateVolumesFromSourceVolumeTest-1150558224 None] Lock "cinder-0b493df9-5f03-4b49-afda-ad04368f58dc-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:38 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:25:38 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:38 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.317s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:25:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Flow 'volume_create_manager' (dc02a2df-2874-4eb9-aefe-b1ef70c17fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dfb7ba-74ad-4c27-a808-cd9ddf30c34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dfb7ba-74ad-4c27-a808-cd9ddf30c34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1947317150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e04946-1ed9-4b74-bd74-b7373a5c9ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95fbaf698fc4a15a4be4198619e120f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:42Z,use_quota=True,user_id='775460378be34268974add047fccbf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58396579-0ffb-4e65-8d6d-83069c68f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58396579-0ffb-4e65-8d6d-83069c68f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876a8619-746e-495e-9db3-91de0182e93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (876a8619-746e-495e-9db3-91de0182e93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e04946-1ed9-4b74-bd74-b7373a5c9ab3', 'volume_name': 'volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320cd8de-9b66-43f5-a977-e570908d8d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320cd8de-9b66-43f5-a977-e570908d8d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8105026e-7d6a-4949-9857-be607c68c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:42 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Volume 05e04946-1ed9-4b74-bd74-b7373a5c9ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3', 'volume_size': 1} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1947317150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e04946-1ed9-4b74-bd74-b7373a5c9ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95fbaf698fc4a15a4be4198619e120f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:25:42Z,use_quota=True,user_id='775460378be34268974add047fccbf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Creating volume 05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:25:42 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:42 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 1073741824 Sep 28 12:25:42 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:42 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 1073741824" returned: 0 in 0.583s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:25:42 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 Sep 28 12:25:42 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:25:43 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 28 12:25:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" returned: 0 in 0.501s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:25:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:25:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:25:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8105026e-7d6a-4949-9857-be607c68c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c32ba27-7340-4d39-bd3c-02f040f5c952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:25:43 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Volume volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 (05e04946-1ed9-4b74-bd74-b7373a5c9ab3): created successfully Sep 28 12:25:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c32ba27-7340-4d39-bd3c-02f040f5c952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:25:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Flow 'volume_create_manager' (dc02a2df-2874-4eb9-aefe-b1ef70c17fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:25:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-016523af-ceed-40e6-87e1-560df31c039c tempest-TestStampPattern-580264828 None] Created volume successfully. Sep 28 12:25:53 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=18,cinder:INSERT=6,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:25:53 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=27,cinder:SELECT=15,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Flow 'volume_create_manager' (b5caf528-6b1d-4b71-8e10-e76328fe6dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c615019-57e2-4cf3-b43c-62d000dcd785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c615019-57e2-4cf3-b43c-62d000dcd785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-520807644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae24e63-6754-42c3-922e-3fe022cebcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d27c27660a4b338816e43f4f999ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:05Z,use_quota=True,user_id='65e807ac14464319b2d795652288940e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473819b5-8234-47bb-8720-d32d0f929ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473819b5-8234-47bb-8720-d32d0f929ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ae31a6-d47c-4519-8a08-564f2b38fea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ae31a6-d47c-4519-8a08-564f2b38fea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ae24e63-6754-42c3-922e-3fe022cebcb1', 'volume_name': 'volume-0ae24e63-6754-42c3-922e-3fe022cebcb1', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e29bde-2afc-4967-bd6c-d7c2d1c413ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e29bde-2afc-4967-bd6c-d7c2d1c413ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf72c71-276c-405d-87b0-ecafd955908d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Volume 0ae24e63-6754-42c3-922e-3fe022cebcb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ae24e63-6754-42c3-922e-3fe022cebcb1', 'volume_size': 1} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-520807644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ae24e63-6754-42c3-922e-3fe022cebcb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27d27c27660a4b338816e43f4f999ad7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:05Z,use_quota=True,user_id='65e807ac14464319b2d795652288940e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Creating volume 0ae24e63-6754-42c3-922e-3fe022cebcb1 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:26:05 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:05 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 1073741824 Sep 28 12:26:05 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Flow 'volume_create_manager' (be4f81c3-14ca-4297-888b-1134e29906f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1399947f-9521-457d-bbb6-bcbeb4a61e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1399947f-9521-457d-bbb6-bcbeb4a61e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1111685202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d902891-5d46-4fa2-bdf8-2a111adde825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e09ee6097d46bcaa180d293c3338f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:05Z,use_quota=True,user_id='ddc6ac97910e46f3a64505c5ee7695f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418363ae-5b77-4d59-a03b-924067bba9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418363ae-5b77-4d59-a03b-924067bba9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fdf868-38cb-4d2d-bd2b-9937c917ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fdf868-38cb-4d2d-bd2b-9937c917ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d902891-5d46-4fa2-bdf8-2a111adde825', 'volume_name': 'volume-9d902891-5d46-4fa2-bdf8-2a111adde825', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae3f9c1-9e5c-47ec-aeba-df9ac5d942db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cae3f9c1-9e5c-47ec-aeba-df9ac5d942db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f831dd6d-960c-42be-96a7-b51b2a24f38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Volume 9d902891-5d46-4fa2-bdf8-2a111adde825: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d902891-5d46-4fa2-bdf8-2a111adde825', 'volume_size': 1} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:05 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 1073741824" returned: 0 in 0.601s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:05 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 Sep 28 12:26:05 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:06 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1" returned: 0 in 0.268s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1111685202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d902891-5d46-4fa2-bdf8-2a111adde825,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6e09ee6097d46bcaa180d293c3338f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:05Z,use_quota=True,user_id='ddc6ac97910e46f3a64505c5ee7695f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Creating volume 9d902891-5d46-4fa2-bdf8-2a111adde825 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:26:06 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf72c71-276c-405d-87b0-ecafd955908d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ae24e63-6754-42c3-922e-3fe022cebcb1', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37e6f97-475b-4c19-a1c6-ddde06ce5d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:06 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 1073741824 Sep 28 12:26:06 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:06 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Volume volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 (0ae24e63-6754-42c3-922e-3fe022cebcb1): created successfully Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37e6f97-475b-4c19-a1c6-ddde06ce5d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Flow 'volume_create_manager' (b5caf528-6b1d-4b71-8e10-e76328fe6dc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b3032678-68f2-4a46-80a4-d3baff90ef69 tempest-AttachVolumeNegativeTest-1520821419 None] Created volume successfully. Sep 28 12:26:06 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 1073741824" returned: 0 in 0.434s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:06 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 Sep 28 12:26:06 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:06 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825" returned: 0 in 0.235s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f831dd6d-960c-42be-96a7-b51b2a24f38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d902891-5d46-4fa2-bdf8-2a111adde825', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34eb77a-03f6-4351-9acb-02fdb0d95996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:06 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Volume volume-9d902891-5d46-4fa2-bdf8-2a111adde825 (9d902891-5d46-4fa2-bdf8-2a111adde825): created successfully Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c34eb77a-03f6-4351-9acb-02fdb0d95996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Flow 'volume_create_manager' (be4f81c3-14ca-4297-888b-1134e29906f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:07 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a297ad70-c457-4b12-a38b-3db93df2b3dd tempest-TestImageHashVerification-234773020 None] Created volume successfully. Sep 28 12:26:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9d8a477a-1652-45bb-b8d0-1cf507a3332c req-0db01522-0b32-4e7d-9740-24edfe27bbda tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9d8a477a-1652-45bb-b8d0-1cf507a3332c req-0db01522-0b32-4e7d-9740-24edfe27bbda tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9d8a477a-1652-45bb-b8d0-1cf507a3332c req-0db01522-0b32-4e7d-9740-24edfe27bbda tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-9d8a477a-1652-45bb-b8d0-1cf507a3332c req-0db01522-0b32-4e7d-9740-24edfe27bbda tempest-AttachVolumeNegativeTest-1520821419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-0ae24e63-6754-42c3-922e-3fe022cebcb1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '08d94266-ef89-40b8-8599-fffa4adbaee0', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:26:08 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-9d8a477a-1652-45bb-b8d0-1cf507a3332c req-0db01522-0b32-4e7d-9740-24edfe27bbda tempest-AttachVolumeNegativeTest-1520821419 None] attachment_update completed successfully. Sep 28 12:26:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:08 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b41e4b-2e61-4e80-9a1c-abce6ea4276c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:08 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 Sep 28 12:26:08 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:09 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825" returned: 0 in 0.526s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:09 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf22fe7-ff70-41a7-aee1-3681c03d7e6a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:09 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 Sep 28 12:26:09 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:09 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825" returned: 0 in 0.426s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 /opt/stack/data/cinder/conversion/9d902891-5d46-4fa2-bdf8-2a111adde825.temp_image.605e3ffb-8606-4a6f-8adc-696525b02d2a9f14oyba.img {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:09 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 /opt/stack/data/cinder/conversion/9d902891-5d46-4fa2-bdf8-2a111adde825.temp_image.605e3ffb-8606-4a6f-8adc-696525b02d2a9f14oyba.img Sep 28 12:26:09 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-7cd20588-0bc6-450b-821f-ba9897bf1978 req-5dd55d2b-a6fd-41ff-86ad-e1c3fe8c6416 tempest-AttachVolumeNegativeTest-1520821419 None] Terminate volume connection completed successfully. Sep 28 12:26:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-7cd20588-0bc6-450b-821f-ba9897bf1978 req-5dd55d2b-a6fd-41ff-86ad-e1c3fe8c6416 tempest-AttachVolumeNegativeTest-1520821419 None] Deleting attachment 08d94266-ef89-40b8-8599-fffa4adbaee0. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:26:18 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 /opt/stack/data/cinder/conversion/9d902891-5d46-4fa2-bdf8-2a111adde825.temp_image.605e3ffb-8606-4a6f-8adc-696525b02d2a9f14oyba.img" returned: 0 in 8.343s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:18 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[442cc451-29b9-4423-888b-dd3b761bde21]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:18 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 Sep 28 12:26:18 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:18 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825" returned: 0 in 0.554s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:18 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825, size 1024.00 MB, duration 8.34 sec, destination /opt/stack/data/cinder/conversion/9d902891-5d46-4fa2-bdf8-2a111adde825.temp_image.605e3ffb-8606-4a6f-8adc-696525b02d2a9f14oyba.img {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:26:18 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Converted 1024.00 MB image at 122.71 MB/s Sep 28 12:26:18 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] 605e3ffb-8606-4a6f-8adc-696525b02d2a was raw, no need to convert to raw {{(pid=87048) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 12:26:19 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "cinder-0ae24e63-6754-42c3-922e-3fe022cebcb1-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:19 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-0ae24e63-6754-42c3-922e-3fe022cebcb1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:19 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "cinder-quobyte-0ae24e63-6754-42c3-922e-3fe022cebcb1" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:19 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-quobyte-0ae24e63-6754-42c3-922e-3fe022cebcb1" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:19 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa9b1bf-d0b6-48fb-b4ec-af1a0cbadfc5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:19 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 Sep 28 12:26:19 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:20 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1" returned: 0 in 0.496s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:20 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1 Sep 28 12:26:20 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-663a4d0f-80f4-4344-8fa6-9cab000ad5c7 req-6b48274a-a30b-4c11-919a-e36c1599e1d8 tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:20 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0ae24e63-6754-42c3-922e-3fe022cebcb1" returned: 0 in 0.276s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-quobyte-0ae24e63-6754-42c3-922e-3fe022cebcb1" released by "delete_volume" :: held 0.851s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Created reservations ['e8d10a96-6c23-4600-bee1-8fc9375fc288', '71312430-1522-42ff-83c4-9d3b21f3cffd', '76a9a346-f487-4da1-9646-979307a8000b', 'c4c806e7-850e-44c0-b58d-7c4a09be59a9'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:20 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:26:20 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "cinder-753cdd32-40e4-46f6-81f0-a9571eb6d138-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-753cdd32-40e4-46f6-81f0-a9571eb6d138-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:21 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.305s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:26:21 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Deleted volume successfully. Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "cinder-quobyte-753cdd32-40e4-46f6-81f0-a9571eb6d138" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d4ca54b4-baef-4266-ac25-1a237b2d610c tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-0ae24e63-6754-42c3-922e-3fe022cebcb1-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-quobyte-753cdd32-40e4-46f6-81f0-a9571eb6d138" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0635f7ea-e503-49ec-8b35-01663f9c12cf]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:21 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 Sep 28 12:26:21 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:21 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138" returned: 0 in 0.420s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:21 devstack sudo[102346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138 Sep 28 12:26:21 devstack sudo[102346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:21 devstack sudo[102346]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-753cdd32-40e4-46f6-81f0-a9571eb6d138" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-quobyte-753cdd32-40e4-46f6-81f0-a9571eb6d138" released by "delete_volume" :: held 0.771s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Created reservations ['a7aee5fc-49eb-4b46-9438-25abe59276f2', '353dd75d-12f2-44ab-bc4d-b6d89cfc7781', 'fbc72dea-d9ac-4aa6-bb30-e7f045d5069b', '31fb1e0f-0a48-4061-8e67-cf986a21885b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:22 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:26:22 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:22 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.335s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:26:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Deleted volume successfully. Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e3c083ee-04b0-4efb-b2af-c0f4ec737e1e tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-753cdd32-40e4-46f6-81f0-a9571eb6d138-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "cinder-01145387-dc4e-44b3-934f-9c10a6472408-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-01145387-dc4e-44b3-934f-9c10a6472408-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "cinder-quobyte-01145387-dc4e-44b3-934f-9c10a6472408" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-quobyte-01145387-dc4e-44b3-934f-9c10a6472408" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[be027d0d-0585-440d-a35b-ecda3e8f1442]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:22 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408 Sep 28 12:26:22 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:23 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408" returned: 0 in 0.402s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:23 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408 Sep 28 12:26:23 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:23 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-01145387-dc4e-44b3-934f-9c10a6472408" returned: 0 in 0.255s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-quobyte-01145387-dc4e-44b3-934f-9c10a6472408" released by "delete_volume" :: held 0.724s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Created reservations ['7ddfcbaf-a882-4257-9be3-f6548281affb', 'e8534a92-39a4-45d4-8291-4f82be9d3972', 'ba66fc63-dee2-42af-8da5-9b6fdf868eec', '6c842134-52bd-46c6-b85e-444f61b4ae97'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:23 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:26:23 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:23 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.318s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:26:23 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Deleted volume successfully. Sep 28 12:26:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-20815e6c-dafb-47c8-8e6b-07b48aaa83c9 tempest-AttachVolumeNegativeTest-1520821419 None] Lock "cinder-01145387-dc4e-44b3-934f-9c10a6472408-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Flow 'volume_create_manager' (c21bfd20-0b02-4b00-8e0d-59dc4e0b76d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85da3c42-f2b3-4858-be56-aa5104e3daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85da3c42-f2b3-4858-be56-aa5104e3daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-304678082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24028e1d-0f44-4361-b568-3425c04c1e28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='112ced8584bc4f65a74ee870d893c4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:32Z,use_quota=True,user_id='8248ad34ba2c44a3a89aa9a5c620cd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b0acb3-ea05-4045-b1c7-d14206e20c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b0acb3-ea05-4045-b1c7-d14206e20c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20431d29-31ea-4e54-822e-35b63e5f9530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20431d29-31ea-4e54-822e-35b63e5f9530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24028e1d-0f44-4361-b568-3425c04c1e28', 'volume_name': 'volume-24028e1d-0f44-4361-b568-3425c04c1e28', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee00bed5-c95c-416e-984c-d44be9eff283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee00bed5-c95c-416e-984c-d44be9eff283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd274a78-0e6c-427e-b0ae-ffb4a83c4b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:32 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Volume 24028e1d-0f44-4361-b568-3425c04c1e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24028e1d-0f44-4361-b568-3425c04c1e28', 'volume_size': 1} Sep 28 12:26:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:38 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:26:38 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:38 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.274s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:26:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.606s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Uploaded volume to glance image-id: 605e3ffb-8606-4a6f-8adc-696525b02d2a. {{(pid=87048) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-663a4d0f-80f4-4344-8fa6-9cab000ad5c7 req-6b48274a-a30b-4c11-919a-e36c1599e1d8 tempest-TestStampPattern-580264828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.766s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-663a4d0f-80f4-4344-8fa6-9cab000ad5c7 req-6b48274a-a30b-4c11-919a-e36c1599e1d8 tempest-TestStampPattern-580264828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.778s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-304678082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24028e1d-0f44-4361-b568-3425c04c1e28,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='112ced8584bc4f65a74ee870d893c4f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:32Z,use_quota=True,user_id='8248ad34ba2c44a3a89aa9a5c620cd0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Creating volume 24028e1d-0f44-4361-b568-3425c04c1e28 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:26:40 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:40 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4462c47a-3895-4ed4-b76d-62f6eeb1fd37 tempest-TestImageHashVerification-234773020 None] Copy volume to image completed successfully. Sep 28 12:26:40 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28 1073741824 Sep 28 12:26:40 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-663a4d0f-80f4-4344-8fa6-9cab000ad5c7 req-6b48274a-a30b-4c11-919a-e36c1599e1d8 tempest-TestStampPattern-580264828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7d15c5a-6eea-4d3d-a2ee-1a83cad0b831', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:26:40 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-663a4d0f-80f4-4344-8fa6-9cab000ad5c7 req-6b48274a-a30b-4c11-919a-e36c1599e1d8 tempest-TestStampPattern-580264828 None] attachment_update completed successfully. Sep 28 12:26:40 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28 1073741824" returned: 0 in 0.495s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:40 devstack sudo[102792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28 Sep 28 12:26:40 devstack sudo[102792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:41 devstack sudo[102792]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28" returned: 0 in 0.290s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd274a78-0e6c-427e-b0ae-ffb4a83c4b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24028e1d-0f44-4361-b568-3425c04c1e28', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab927068-bd88-4839-bd24-4174636d4f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:41 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Volume volume-24028e1d-0f44-4361-b568-3425c04c1e28 (24028e1d-0f44-4361-b568-3425c04c1e28): created successfully Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab927068-bd88-4839-bd24-4174636d4f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Flow 'volume_create_manager' (c21bfd20-0b02-4b00-8e0d-59dc4e0b76d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:41 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-0d728b0a-af82-4c55-90aa-975aaa1310fa req-dfff4d8e-812a-4c63-a12f-13c3dd9b3853 tempest-VolumesGetTestJSON-404021059 None] Created volume successfully. Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Acquiring lock "cinder-9d902891-5d46-4fa2-bdf8-2a111adde825-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Lock "cinder-9d902891-5d46-4fa2-bdf8-2a111adde825-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Acquiring lock "cinder-quobyte-9d902891-5d46-4fa2-bdf8-2a111adde825" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Lock "cinder-quobyte-9d902891-5d46-4fa2-bdf8-2a111adde825" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfa80ab-defd-4a7b-985d-16c0a4bcb873]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:41 devstack sudo[102798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 Sep 28 12:26:41 devstack sudo[102798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:42 devstack sudo[102798]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825" returned: 0 in 0.408s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:42 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825 Sep 28 12:26:42 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Acquiring lock "cinder-24028e1d-0f44-4361-b568-3425c04c1e28-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Lock "cinder-24028e1d-0f44-4361-b568-3425c04c1e28-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Acquiring lock "cinder-quobyte-24028e1d-0f44-4361-b568-3425c04c1e28" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:42 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d902891-5d46-4fa2-bdf8-2a111adde825" returned: 0 in 0.287s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Lock "cinder-quobyte-9d902891-5d46-4fa2-bdf8-2a111adde825" released by "delete_volume" :: held 0.737s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Lock "cinder-quobyte-24028e1d-0f44-4361-b568-3425c04c1e28" acquired by "delete_volume" :: waited 0.029s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76f6696-f927-4916-98e9-3903b9ee4675]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Created reservations ['538bc36e-bade-4d63-be38-ab5b89be61f6', '35489ebb-aadb-477f-93e1-835c90eb78b0', '55b6dd87-41b2-4b56-b775-921e5463a608', 'b247b706-adc4-4aef-bdf9-f0f24db7c002'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:26:42 devstack sudo[102816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28 Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:42 devstack sudo[102816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:42 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:26:42 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:43 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.286s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:26:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Deleted volume successfully. Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9a4a626d-ed0b-4360-abef-79668d276ccb tempest-TestImageHashVerification-234773020 None] Lock "cinder-9d902891-5d46-4fa2-bdf8-2a111adde825-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:43 devstack sudo[102816]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28" returned: 0 in 0.488s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:43 devstack sudo[102825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28 Sep 28 12:26:43 devstack sudo[102825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:43 devstack sudo[102825]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-24028e1d-0f44-4361-b568-3425c04c1e28" returned: 0 in 0.296s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Lock "cinder-quobyte-24028e1d-0f44-4361-b568-3425c04c1e28" released by "delete_volume" :: held 0.839s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG cinder.quota [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Created reservations ['5602ebae-17e0-4223-85d1-519ae5a850de', '06290142-7a0a-40cd-a65e-cf0ebcc99370', '8c5efff0-5c03-42f0-8131-5aa2ecfaba09', '0febb441-72d6-45ad-9251-af559e69c820'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:43 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:26:43 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:43 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.365s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG cinder.manager [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:26:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Deleted volume successfully. Sep 28 12:26:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [req-9708f22c-97b4-40f0-985b-1eb6c72fbcbc req-30c969bf-63d8-456c-bd15-5b232ca13e97 tempest-VolumesGetTestJSON-404021059 None] Lock "cinder-24028e1d-0f44-4361-b568-3425c04c1e28-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-96d01893-4c1c-46b1-9444-3773db199d62 req-5b234ac2-8264-47a4-abe1-ab2a2d676df8 tempest-TestStampPattern-580264828 None] Terminate volume connection completed successfully. Sep 28 12:26:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-96d01893-4c1c-46b1-9444-3773db199d62 req-5b234ac2-8264-47a4-abe1-ab2a2d676df8 tempest-TestStampPattern-580264828 None] Deleting attachment d7d15c5a-6eea-4d3d-a2ee-1a83cad0b831. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:26:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Creating offline snapshot 627af43c-d7a3-4cc2-99ef-cbf687ffed58 of volume 05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:26:47 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c75754-36b6-4b00-b4ac-8ea73788216a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:47 devstack sudo[102875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 Sep 28 12:26:47 devstack sudo[102875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:47 devstack sudo[102875]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" returned: 0 in 0.445s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:47 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 1G Sep 28 12:26:47 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:48 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 1G" returned: 0 in 0.573s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:48 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 Sep 28 12:26:48 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:48 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58" returned: 0 in 0.351s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:48 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 is being set with open permissions: ugo+rw Sep 28 12:26:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:48 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 Sep 28 12:26:48 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:48 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58" returned: 0 in 0.298s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:49 devstack sudo[102896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.info Sep 28 12:26:49 devstack sudo[102896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5d6a9893-9a72-43d2-8af9-2f4da4a52057 tempest-GroupSnapshotsV319Test-1818110252 None] Group tempest-GroupSnapshotsV319Test-Group-404959974: creating Sep 28 12:26:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5d6a9893-9a72-43d2-8af9-2f4da4a52057 tempest-GroupSnapshotsV319Test-1818110252 None] Group tempest-GroupSnapshotsV319Test-Group-404959974: created successfully Sep 28 12:26:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5d6a9893-9a72-43d2-8af9-2f4da4a52057 tempest-GroupSnapshotsV319Test-1818110252 None] Create group completed successfully. Sep 28 12:26:49 devstack sudo[102896]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.info" returned: 0 in 0.313s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:49 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.info is being set with open permissions: ugo+rw Sep 28 12:26:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:49 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.info Sep 28 12:26:49 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:49 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.info" returned: 0 in 0.265s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-766d20f9-e8d0-445c-b880-406ae2db1dbb tempest-TestStampPattern-580264828 None] Create snapshot completed successfully Sep 28 12:26:50 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:26:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Flow 'volume_create_manager' (6c66feed-622a-4f4a-852c-8403b2a8eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de4eac8-40c3-49ea-b672-27cf046f0e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de4eac8-40c3-49ea-b672-27cf046f0e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839321832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38c8dec2-3a4f-4cde-9dff-f20bdef7db2a,host='devstack@QuobyteHD#QuobyteHD',id=c90ddcfa-9bab-4647-addc-dd8c06e892a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0fdb5a1f9d4d629536cc9fb6b6ae85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:51Z,use_quota=True,user_id='63f3d65cbdd348c7a889286dd861bb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7730a0b-030a-4f93-be5b-5b811ad152e4),volume_type_id=a7730a0b-030a-4f93-be5b-5b811ad152e4)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4987d758-e5f2-4f3c-9543-374e9f07d220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4987d758-e5f2-4f3c-9543-374e9f07d220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d037236-cdfe-4616-a00b-6b2fe8eb4c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d037236-cdfe-4616-a00b-6b2fe8eb4c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90ddcfa-9bab-4647-addc-dd8c06e892a3', 'volume_name': 'volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dab955-9752-4cc1-942d-107752b9253c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9dab955-9752-4cc1-942d-107752b9253c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf0cd08-6a8c-4601-a83a-50a932c96d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:51 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Volume c90ddcfa-9bab-4647-addc-dd8c06e892a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3', 'volume_size': 1} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=38c8dec2-3a4f-4cde-9dff-f20bdef7db2a,created_at=2026-09-28T10:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839321832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38c8dec2-3a4f-4cde-9dff-f20bdef7db2a,host='devstack@QuobyteHD#QuobyteHD',id=c90ddcfa-9bab-4647-addc-dd8c06e892a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a0fdb5a1f9d4d629536cc9fb6b6ae85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:51Z,use_quota=True,user_id='63f3d65cbdd348c7a889286dd861bb0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7730a0b-030a-4f93-be5b-5b811ad152e4),volume_type_id=a7730a0b-030a-4f93-be5b-5b811ad152e4)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Creating volume c90ddcfa-9bab-4647-addc-dd8c06e892a3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:26:51 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:51 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 1073741824 Sep 28 12:26:51 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:51 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 1073741824" returned: 0 in 0.584s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:51 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 Sep 28 12:26:51 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:51 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3" returned: 0 in 0.287s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf0cd08-6a8c-4601-a83a-50a932c96d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7ccfc2-a63e-4cce-a030-cb797960d1b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:51 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Volume volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 (c90ddcfa-9bab-4647-addc-dd8c06e892a3): created successfully Sep 28 12:26:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7ccfc2-a63e-4cce-a030-cb797960d1b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Flow 'volume_create_manager' (6c66feed-622a-4f4a-852c-8403b2a8eb92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c114074c-aae7-45a2-950b-e1a5e879d7d0 tempest-GroupSnapshotsV319Test-1818110252 None] Created volume successfully. Sep 28 12:26:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] GroupSnapshot e83dcbb7-5a7d-4a2b-948c-df5dfd585634: creating. Sep 28 12:26:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Group snapshot e83dcbb7-5a7d-4a2b-948c-df5dfd585634: creating. {{(pid=87048) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 12:26:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Creating offline snapshot fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 of volume c90ddcfa-9bab-4647-addc-dd8c06e892a3 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:26:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a6e5b9-c89e-4fd8-88fa-d90b06a563ba]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:54 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 Sep 28 12:26:54 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:54 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3" returned: 0 in 0.372s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:54 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 1G Sep 28 12:26:54 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:54 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 1G" returned: 0 in 0.511s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:54 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 Sep 28 12:26:54 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:55 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482" returned: 0 in 0.421s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:55 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:26:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:55 devstack sudo[102974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 Sep 28 12:26:55 devstack sudo[102974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:55 devstack sudo[102974]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482" returned: 0 in 0.301s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:55 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.info Sep 28 12:26:55 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:55 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.info" returned: 0 in 0.298s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:55 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 12:26:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:55 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.info Sep 28 12:26:55 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:56 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.info" returned: 0 in 0.319s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.328s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:56 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-fe766821-8add-4e07-95a9-42349711861c tempest-GroupSnapshotsV319Test-1818110252 None] group_snapshot e83dcbb7-5a7d-4a2b-948c-df5dfd585634: created successfully Sep 28 12:26:57 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] group_snapshot e83dcbb7-5a7d-4a2b-948c-df5dfd585634: deleting Sep 28 12:26:57 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] group_snapshot e83dcbb7-5a7d-4a2b-948c-df5dfd585634: deleting {{(pid=87048) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 12:26:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Acquiring lock "cinder-quobyte-c90ddcfa-9bab-4647-addc-dd8c06e892a3" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Lock "cinder-quobyte-c90ddcfa-9bab-4647-addc-dd8c06e892a3" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Acquiring lock "cinder-quobyte-fd1219d5-0b71-4c28-9d4a-22d8ee8cf482" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:26:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Lock "cinder-quobyte-fd1219d5-0b71-4c28-9d4a-22d8ee8cf482" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:26:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Deleting offline snapshot fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 of volume c90ddcfa-9bab-4647-addc-dd8c06e892a3 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:26:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] snapshot_file for this snap is: volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:26:57 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba51e31-4c57-4a64-ab10-5f7ba2239c33]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:57 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 Sep 28 12:26:57 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:58 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482" returned: 0 in 0.431s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:26:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[49176911-5f73-4af7-866a-0fc52fc61e8a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:26:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:58 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 Sep 28 12:26:58 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:58 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3" returned: 0 in 0.418s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:58 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 Sep 28 12:26:58 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:59 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482" returned: 0 in 0.421s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:59 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482 Sep 28 12:26:59 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Flow 'volume_create_manager' (060def00-5d3b-402f-b58f-c77012981f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4b323d-2299-4c69-8d62-b42258121853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f4b323d-2299-4c69-8d62-b42258121853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067439505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daab4fb9-9ba2-4757-bca6-5eb247bbcdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63a332087ca4a27b97dbea4c5795a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:59Z,use_quota=True,user_id='e5278b4244b54e5f90b389406ae01443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4ed021-2d67-4b18-b6c3-9177aa60a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4ed021-2d67-4b18-b6c3-9177aa60a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa23a709-5f2b-4789-9a81-632c0aae4654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa23a709-5f2b-4789-9a81-632c0aae4654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daab4fb9-9ba2-4757-bca6-5eb247bbcdac', 'volume_name': 'volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aff9978-d147-426d-89b6-9c7cce6bb305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aff9978-d147-426d-89b6-9c7cce6bb305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9b8c8b-e6ff-476c-aa90-4044f115dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Volume daab4fb9-9ba2-4757-bca6-5eb247bbcdac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac', 'volume_size': 1} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1067439505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daab4fb9-9ba2-4757-bca6-5eb247bbcdac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63a332087ca4a27b97dbea4c5795a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:26:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:26:59Z,use_quota=True,user_id='e5278b4244b54e5f90b389406ae01443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Creating volume daab4fb9-9ba2-4757-bca6-5eb247bbcdac {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:26:59 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:59 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac 1073741824 Sep 28 12:26:59 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:26:59 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3.fd1219d5-0b71-4c28-9d4a-22d8ee8cf482" returned: 0 in 0.292s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Lock "cinder-quobyte-fd1219d5-0b71-4c28-9d4a-22d8ee8cf482" released by "_delete_snapshot" :: held 1.732s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Lock "cinder-quobyte-c90ddcfa-9bab-4647-addc-dd8c06e892a3" released by "delete_snapshot" :: held 1.765s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:26:59 devstack cinder-volume[87048]: WARNING cinder.quota [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-842103065 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-842103065, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:26:59 devstack cinder-volume[87048]: WARNING cinder.quota [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-842103065 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-842103065, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] Created reservations ['eec1becc-8ca1-4a02-a735-ff62acf5461d', 'e5aaa132-0977-4858-b499-5287915af96c', 'df8910ac-2bba-427a-a6bb-3d5c82b4d935', '5cfa7b3c-78a5-49b5-8aa9-1089205b6a24'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Flow 'volume_create_manager' (b17a949b-78ae-4e47-af74-0d164eb5358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e67b9b-0a65-41d1-89da-d84cb4ac91ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-71f03fb3-4565-45b0-92f1-f4f06e9e855b tempest-GroupSnapshotsV319Test-1818110252 None] group_snapshot e83dcbb7-5a7d-4a2b-948c-df5dfd585634: deleted successfully Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65e67b9b-0a65-41d1-89da-d84cb4ac91ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-818280146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa11bc4a-911e-466d-a6da-ac994041c1eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e95fbaf698fc4a15a4be4198619e120f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=627af43c-d7a3-4cc2-99ef-cbf687ffed58,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:00Z,use_quota=True,user_id='775460378be34268974add047fccbf6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8f61d8-6469-416a-8435-1b10eb9b5e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a8f61d8-6469-416a-8435-1b10eb9b5e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1388a6-c964-48a1-9a93-d3d6a198caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd1388a6-c964-48a1-9a93-d3d6a198caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa11bc4a-911e-466d-a6da-ac994041c1eb', 'volume_name': 'volume-aa11bc4a-911e-466d-a6da-ac994041c1eb', 'volume_size': 1, 'snapshot_id': '627af43c-d7a3-4cc2-99ef-cbf687ffed58'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3e7f70-2940-4fcb-a0ca-7c23a07bacab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3e7f70-2940-4fcb-a0ca-7c23a07bacab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55356326-f586-448e-b85a-e14a13bc9341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:26:59 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Volume aa11bc4a-911e-466d-a6da-ac994041c1eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa11bc4a-911e-466d-a6da-ac994041c1eb', 'volume_size': 1, 'snapshot_id': '627af43c-d7a3-4cc2-99ef-cbf687ffed58'} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:26:59 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac 1073741824" returned: 0 in 0.565s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:26:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:26:59 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac Sep 28 12:26:59 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:00 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac" returned: 0 in 0.304s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.375s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Acquiring lock "cinder-quobyte-627af43c-d7a3-4cc2-99ef-cbf687ffed58-aa11bc4a-911e-466d-a6da-ac994041c1eb" by "_create_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd9b8c8b-e6ff-476c-aa90-4044f115dc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67a8636-61be-47fe-bf48-3568ec0963cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-627af43c-d7a3-4cc2-99ef-cbf687ffed58-aa11bc4a-911e-466d-a6da-ac994041c1eb" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Creating volume aa11bc4a-911e-466d-a6da-ac994041c1eb from snapshot 627af43c-d7a3-4cc2-99ef-cbf687ffed58 {{(pid=87048) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Acquiring lock "cinder-quobyte-aa11bc4a-911e-466d-a6da-ac994041c1eb" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-aa11bc4a-911e-466d-a6da-ac994041c1eb" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] snapshot: 627af43c-d7a3-4cc2-99ef-cbf687ffed58, volume: aa11bc4a-911e-466d-a6da-ac994041c1eb, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:27:00 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Volume volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac (daab4fb9-9ba2-4757-bca6-5eb247bbcdac): created successfully Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d67a8636-61be-47fe-bf48-3568ec0963cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Flow 'volume_create_manager' (060def00-5d3b-402f-b58f-c77012981f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:00 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2b01fa0c-fc53-4fac-9a96-bc25114361e0 tempest-ProjectReaderTests-795578094 None] Created volume successfully. Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e4cf27-407f-4fdf-a085-3209269f5f16]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Acquiring lock "cinder-quobyte-c90ddcfa-9bab-4647-addc-dd8c06e892a3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Lock "cinder-quobyte-c90ddcfa-9bab-4647-addc-dd8c06e892a3" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8242dab-e8ff-4c07-8e01-81acbb95ded0]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:00 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 Sep 28 12:27:00 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:00 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 Sep 28 12:27:00 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:00 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58" returned: 0 in 0.453s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1c5be9-6b58-4a25-8061-60c9e215665f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:00 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3" returned: 0 in 0.473s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:00 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 Sep 28 12:27:00 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:00 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3 Sep 28 12:27:00 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:01 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c90ddcfa-9bab-4647-addc-dd8c06e892a3" returned: 0 in 0.318s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Lock "cinder-quobyte-c90ddcfa-9bab-4647-addc-dd8c06e892a3" released by "delete_volume" :: held 0.887s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Created reservations ['19a9416d-1fcf-450c-b533-d516269d6887'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:01 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" returned: 0 in 0.559s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:01 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb Sep 28 12:27:01 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:01 devstack cinder-volume[87048]: WARNING cinder.quota [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-842103065 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-842103065, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Created reservations ['3242dbb9-2800-4571-8057-25026c70a9de', '24ff42f9-1210-4194-a88b-70e50affd15f', '17aba5ca-46c6-4abb-98e6-5e2fb094316e', '0d99770f-6a2f-4a8d-b068-9b6e45274f0c'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Acquiring lock "cinder-daab4fb9-9ba2-4757-bca6-5eb247bbcdac-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Lock "cinder-daab4fb9-9ba2-4757-bca6-5eb247bbcdac-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Acquiring lock "cinder-quobyte-daab4fb9-9ba2-4757-bca6-5eb247bbcdac" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Lock "cinder-quobyte-daab4fb9-9ba2-4757-bca6-5eb247bbcdac" acquired by "delete_volume" :: waited 0.043s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6fa55e-3da2-4f29-994f-848ffca5a794]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:01 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:27:01 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:01 devstack sudo[103070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac Sep 28 12:27:01 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:02 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.443s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:02 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:02 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8cbcd9f7-14b2-46db-b1ba-146596f38619 tempest-GroupSnapshotsV319Test-1818110252 None] Delete group completed successfully. Sep 28 12:27:02 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac" returned: 0 in 0.685s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:02 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac Sep 28 12:27:02 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:02 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-daab4fb9-9ba2-4757-bca6-5eb247bbcdac" returned: 0 in 0.521s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Lock "cinder-quobyte-daab4fb9-9ba2-4757-bca6-5eb247bbcdac" released by "delete_volume" :: held 1.295s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:03 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Created reservations ['45ee9a5e-a1ff-4bdf-bfab-8abe3a29305e', 'd7dd30b7-8933-4a47-81e3-8aca695db7ec', '1b9cf32a-ef2c-4926-a7aa-89f30258317c', '72bdde2c-355a-4fcd-966f-84cdd24acfae'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:03 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:27:03 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:04 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.662s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:04 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Deleted volume successfully. Sep 28 12:27:04 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=77,cinder:UPDATE=93,cinder:DELETE=10,cinder:INSERT=18 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:27:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7d0ce0b1-581c-4bbb-8e18-7faaa978d2bb tempest-ProjectReaderTests-795578094 None] Lock "cinder-daab4fb9-9ba2-4757-bca6-5eb247bbcdac-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=85,cinder:SELECT=95,cinder:INSERT=22,cinder:DELETE=2 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Flow 'volume_create_manager' (35c2643e-37b7-46d9-91be-6b0b3fc9f1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb30229b-4b81-45a7-824d-269349e513ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb30229b-4b81-45a7-824d-269349e513ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205195506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b032b468-2062-4e15-a137-91d640ea0294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63a332087ca4a27b97dbea4c5795a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:05Z,use_quota=True,user_id='e5278b4244b54e5f90b389406ae01443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d69916-b82c-4e4c-a368-6d7404da51d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d69916-b82c-4e4c-a368-6d7404da51d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781a6f04-481b-4062-85f3-f6adb251c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781a6f04-481b-4062-85f3-f6adb251c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b032b468-2062-4e15-a137-91d640ea0294', 'volume_name': 'volume-b032b468-2062-4e15-a137-91d640ea0294', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ffc301-536d-4019-b933-505c7863bdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94ffc301-536d-4019-b933-505c7863bdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf3f776-5a59-423e-8d49-862015607775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Volume b032b468-2062-4e15-a137-91d640ea0294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b032b468-2062-4e15-a137-91d640ea0294', 'volume_size': 1} Sep 28 12:27:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:12 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb" returned: 0 in 10.955s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3, size 1024.00 MB, duration 10.96 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:27:12 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Converted 1024.00 MB image at 93.46 MB/s Sep 28 12:27:12 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb is being set with open permissions: ugo+rw Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:12 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb Sep 28 12:27:12 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:12 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb" returned: 0 in 0.340s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-aa11bc4a-911e-466d-a6da-ac994041c1eb" released by "_copy_volume_from_snapshot" :: held 12.452s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-627af43c-d7a3-4cc2-99ef-cbf687ffed58-aa11bc4a-911e-466d-a6da-ac994041c1eb" released by "_create_volume_from_snapshot" :: held 12.530s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.566s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.321s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1205195506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b032b468-2062-4e15-a137-91d640ea0294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63a332087ca4a27b97dbea4c5795a48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:05Z,use_quota=True,user_id='e5278b4244b54e5f90b389406ae01443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Creating volume b032b468-2062-4e15-a137-91d640ea0294 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:27:12 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:12 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294 1073741824 Sep 28 12:27:12 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55356326-f586-448e-b85a-e14a13bc9341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa11bc4a-911e-466d-a6da-ac994041c1eb', 'volume_size': 1, 'snapshot_id': '627af43c-d7a3-4cc2-99ef-cbf687ffed58'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb865ac-0298-4f6b-b101-e6cf084adecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:12 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Volume volume-aa11bc4a-911e-466d-a6da-ac994041c1eb (aa11bc4a-911e-466d-a6da-ac994041c1eb): created successfully Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb865ac-0298-4f6b-b101-e6cf084adecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Flow 'volume_create_manager' (b17a949b-78ae-4e47-af74-0d164eb5358b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0bfe7f91-908b-4a4b-9ec6-f528c3c4c26a tempest-TestStampPattern-580264828 None] Created volume successfully. Sep 28 12:27:13 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294 1073741824" returned: 0 in 0.496s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:13 devstack sudo[103203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294 Sep 28 12:27:13 devstack sudo[103203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:13 devstack sudo[103203]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294" returned: 0 in 0.262s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:27:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcf3f776-5a59-423e-8d49-862015607775) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b032b468-2062-4e15-a137-91d640ea0294', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befddf12-9dc5-4fc8-a3d7-566ff439e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:13 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Volume volume-b032b468-2062-4e15-a137-91d640ea0294 (b032b468-2062-4e15-a137-91d640ea0294): created successfully Sep 28 12:27:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befddf12-9dc5-4fc8-a3d7-566ff439e877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Flow 'volume_create_manager' (35c2643e-37b7-46d9-91be-6b0b3fc9f1be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-29f0870b-8981-4ecc-a753-7078219f748b tempest-ProjectReaderTests-795578094 None] Created volume successfully. Sep 28 12:27:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Acquiring lock "cinder-b032b468-2062-4e15-a137-91d640ea0294-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Lock "cinder-b032b468-2062-4e15-a137-91d640ea0294-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Acquiring lock "cinder-quobyte-b032b468-2062-4e15-a137-91d640ea0294" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Lock "cinder-quobyte-b032b468-2062-4e15-a137-91d640ea0294" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:14 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[82191753-1875-4005-a5ea-b4773eaa1070]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:14 devstack sudo[103208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294 Sep 28 12:27:14 devstack sudo[103208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:14 devstack sudo[103208]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294" returned: 0 in 0.394s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:14 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294 Sep 28 12:27:14 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:15 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b032b468-2062-4e15-a137-91d640ea0294" returned: 0 in 0.301s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Lock "cinder-quobyte-b032b468-2062-4e15-a137-91d640ea0294" released by "delete_volume" :: held 0.765s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Created reservations ['09b23734-8f6d-46f9-8746-1778bfa0e708', '9e8d0f7e-9c37-416b-8dd5-2a57f544c0a4', '2c1bd127-5c20-420c-9a77-1c5375da232a', 'aa8cb495-e7cb-48c7-8f00-0af9f8ed17e3'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1e2b2981-1082-45fe-8c88-43e8933623c9 tempest-GroupsTest-1730928123 None] Group tempest-Group1-1729035554: creating Sep 28 12:27:15 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:27:15 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1e2b2981-1082-45fe-8c88-43e8933623c9 tempest-GroupsTest-1730928123 None] Group tempest-Group1-1729035554: created successfully Sep 28 12:27:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1e2b2981-1082-45fe-8c88-43e8933623c9 tempest-GroupsTest-1730928123 None] Create group completed successfully. Sep 28 12:27:15 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.415s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Deleted volume successfully. Sep 28 12:27:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a16132e3-59a5-46d8-9568-60e032f08382 tempest-ProjectReaderTests-795578094 None] Lock "cinder-b032b468-2062-4e15-a137-91d640ea0294-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f031b794-372f-4dca-a929-f467fd222780 tempest-GroupsTest-1730928123 None] Group tempest-Group2-74075093: creating Sep 28 12:27:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f031b794-372f-4dca-a929-f467fd222780 tempest-GroupsTest-1730928123 None] Group tempest-Group2-74075093: created successfully Sep 28 12:27:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f031b794-372f-4dca-a929-f467fd222780 tempest-GroupsTest-1730928123 None] Create group completed successfully. Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Flow 'volume_create_manager' (f111d587-5241-4d20-bf6a-8ef30df0aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea852381-39bd-4362-a9b0-951fa3cf1396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea852381-39bd-4362-a9b0-951fa3cf1396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067934550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6889d07e-963d-4b94-a9dc-7f7dbb89843d,host='devstack@QuobyteHD#QuobyteHD',id=8c7f9be2-383b-426d-953c-49ec53b23c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630a1e93e019465e9ec99c263bfef2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:19Z,use_quota=True,user_id='3101a90c6ae945df9016cae60ff589ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(561aa98f-aeb3-44cc-8dcc-834200e99223),volume_type_id=561aa98f-aeb3-44cc-8dcc-834200e99223)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97815503-174e-41ee-8edc-8dccc2d52652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97815503-174e-41ee-8edc-8dccc2d52652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d89532b-5f1d-40be-bb79-ddfd40b2d4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d89532b-5f1d-40be-bb79-ddfd40b2d4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c7f9be2-383b-426d-953c-49ec53b23c57', 'volume_name': 'volume-8c7f9be2-383b-426d-953c-49ec53b23c57', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bccf69d-ebe8-490a-a7ad-1a04def7f8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bccf69d-ebe8-490a-a7ad-1a04def7f8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0039212-33e1-4c7d-b8e8-526b429b758b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Volume 8c7f9be2-383b-426d-953c-49ec53b23c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c7f9be2-383b-426d-953c-49ec53b23c57', 'volume_size': 1} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6889d07e-963d-4b94-a9dc-7f7dbb89843d,created_at=2026-09-28T10:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1067934550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6889d07e-963d-4b94-a9dc-7f7dbb89843d,host='devstack@QuobyteHD#QuobyteHD',id=8c7f9be2-383b-426d-953c-49ec53b23c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630a1e93e019465e9ec99c263bfef2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:19Z,use_quota=True,user_id='3101a90c6ae945df9016cae60ff589ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(561aa98f-aeb3-44cc-8dcc-834200e99223),volume_type_id=561aa98f-aeb3-44cc-8dcc-834200e99223)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Creating volume 8c7f9be2-383b-426d-953c-49ec53b23c57 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:27:18 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:27:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:18 devstack sudo[103221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57 1073741824 Sep 28 12:27:18 devstack sudo[103221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:19 devstack sudo[103221]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57 1073741824" returned: 0 in 0.499s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:19 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57 Sep 28 12:27:19 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:19 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57" returned: 0 in 0.268s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:27:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0039212-33e1-4c7d-b8e8-526b429b758b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c7f9be2-383b-426d-953c-49ec53b23c57', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816a521b-a24c-47fc-97dc-5333abd4b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:19 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Volume volume-8c7f9be2-383b-426d-953c-49ec53b23c57 (8c7f9be2-383b-426d-953c-49ec53b23c57): created successfully Sep 28 12:27:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (816a521b-a24c-47fc-97dc-5333abd4b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Flow 'volume_create_manager' (f111d587-5241-4d20-bf6a-8ef30df0aafe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:19 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4f29946c-e34e-4be5-9621-73b91124bf73 tempest-GroupsTest-1730928123 None] Created volume successfully. Sep 28 12:27:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Acquiring lock "cinder-quobyte-8c7f9be2-383b-426d-953c-49ec53b23c57" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Lock "cinder-quobyte-8c7f9be2-383b-426d-953c-49ec53b23c57" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:20 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[02200687-9746-4ece-ab6b-f657e0247619]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:20 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57 Sep 28 12:27:20 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:20 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57" returned: 0 in 0.460s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:21 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57 Sep 28 12:27:21 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:21 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8c7f9be2-383b-426d-953c-49ec53b23c57" returned: 0 in 0.297s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Lock "cinder-quobyte-8c7f9be2-383b-426d-953c-49ec53b23c57" released by "delete_volume" :: held 0.815s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Created reservations ['e3c3b022-605e-4cdd-ad5e-749899a8fd9b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:21 devstack cinder-volume[87048]: WARNING cinder.quota [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2031983686 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2031983686, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:27:21 devstack cinder-volume[87048]: WARNING cinder.quota [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2031983686 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2031983686, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Created reservations ['74fcf0c1-2e76-4922-a955-91821072bcf3', '9b0be06c-8418-4639-b1ec-82cda6e533f8', '05626894-77e1-4c64-9c9e-402a3991a949', 'cd79eddd-e8df-44ec-9c80-4a1ca6ece1e2'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:21 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:27:21 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:21 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.369s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:21 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a3d95afd-645e-4cd6-a988-fb6267ee3b05 tempest-GroupsTest-1730928123 None] Delete group completed successfully. Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] Created reservations ['82eb5243-8084-41e5-baf5-86845019f71c'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:22 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:27:22 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:22 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.274s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:22 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-869594bf-3f7d-48a5-8511-07433946d6e1 tempest-GroupsTest-1730928123 None] Delete group completed successfully. Sep 28 12:27:23 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-76ef1186-809b-4b2e-bb42-37c43a13866e tempest-GroupsTest-1730928123 None] Group tempest-GroupsTest-Group-413759345: creating Sep 28 12:27:23 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-76ef1186-809b-4b2e-bb42-37c43a13866e tempest-GroupsTest-1730928123 None] Group tempest-GroupsTest-Group-413759345: created successfully Sep 28 12:27:23 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-76ef1186-809b-4b2e-bb42-37c43a13866e tempest-GroupsTest-1730928123 None] Create group completed successfully. Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Flow 'volume_create_manager' (188385f8-e6ee-4c8a-94d3-8fceea3963e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695754e4-559d-45a3-95eb-fd13595a8f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695754e4-559d-45a3-95eb-fd13595a8f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1310426132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5a8d3ef-74fb-4ba8-8534-476dd678fed0,host='devstack@QuobyteHD#QuobyteHD',id=e1c54860-f47c-4836-9fab-128970e85deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630a1e93e019465e9ec99c263bfef2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:25Z,use_quota=True,user_id='3101a90c6ae945df9016cae60ff589ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb8a2363-157a-478d-862c-a53240f0a0a9),volume_type_id=bb8a2363-157a-478d-862c-a53240f0a0a9)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330138c9-336d-4b8a-9bb9-bae2ada4469f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330138c9-336d-4b8a-9bb9-bae2ada4469f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325cf18b-9409-4d5a-b83b-0f87ff0503d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325cf18b-9409-4d5a-b83b-0f87ff0503d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c54860-f47c-4836-9fab-128970e85deb', 'volume_name': 'volume-e1c54860-f47c-4836-9fab-128970e85deb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea8e4ab-e1b4-4d38-9902-58ac5bbef7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea8e4ab-e1b4-4d38-9902-58ac5bbef7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdb0ffe-12de-4f2b-8f63-f1dd1ca993b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:25 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Volume e1c54860-f47c-4836-9fab-128970e85deb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c54860-f47c-4836-9fab-128970e85deb', 'volume_size': 1} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b5a8d3ef-74fb-4ba8-8534-476dd678fed0,created_at=2026-09-28T10:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1310426132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5a8d3ef-74fb-4ba8-8534-476dd678fed0,host='devstack@QuobyteHD#QuobyteHD',id=e1c54860-f47c-4836-9fab-128970e85deb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630a1e93e019465e9ec99c263bfef2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:25Z,use_quota=True,user_id='3101a90c6ae945df9016cae60ff589ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb8a2363-157a-478d-862c-a53240f0a0a9),volume_type_id=bb8a2363-157a-478d-862c-a53240f0a0a9)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Creating volume e1c54860-f47c-4836-9fab-128970e85deb {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:27:25 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:25 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb 1073741824 Sep 28 12:27:25 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:25 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb 1073741824" returned: 0 in 0.504s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:25 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb Sep 28 12:27:25 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:26 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb" returned: 0 in 0.325s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:27:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdb0ffe-12de-4f2b-8f63-f1dd1ca993b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c54860-f47c-4836-9fab-128970e85deb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51fd5a6-a6a4-4f3e-977e-12fc0f55cdc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:26 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Volume volume-e1c54860-f47c-4836-9fab-128970e85deb (e1c54860-f47c-4836-9fab-128970e85deb): created successfully Sep 28 12:27:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b51fd5a6-a6a4-4f3e-977e-12fc0f55cdc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Flow 'volume_create_manager' (188385f8-e6ee-4c8a-94d3-8fceea3963e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:26 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-69992898-ea52-45c6-bd09-5140bdba9a26 tempest-GroupsTest-1730928123 None] Created volume successfully. Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Flow 'volume_create_manager' (e24bf950-1d48-4aeb-a0c7-780c8ae55221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23ed823-b72c-4e18-a555-e0f21b856b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b23ed823-b72c-4e18-a555-e0f21b856b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1073009958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5a8d3ef-74fb-4ba8-8534-476dd678fed0,host='devstack@QuobyteHD#QuobyteHD',id=8db9d9c1-aff8-46b5-9100-f578ac068bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630a1e93e019465e9ec99c263bfef2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:27Z,use_quota=True,user_id='3101a90c6ae945df9016cae60ff589ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb8a2363-157a-478d-862c-a53240f0a0a9),volume_type_id=bb8a2363-157a-478d-862c-a53240f0a0a9)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eece4544-9a97-433b-9904-e5e93abf4497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eece4544-9a97-433b-9904-e5e93abf4497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92825982-f80c-4130-8676-4865d95a88da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92825982-f80c-4130-8676-4865d95a88da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db9d9c1-aff8-46b5-9100-f578ac068bb9', 'volume_name': 'volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4b198b-7a36-498d-8708-209ae96c9703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f4b198b-7a36-498d-8708-209ae96c9703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f90a60-c032-4910-b2d1-05eb70d1d680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:27 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Volume 8db9d9c1-aff8-46b5-9100-f578ac068bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9', 'volume_size': 1} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b5a8d3ef-74fb-4ba8-8534-476dd678fed0,created_at=2026-09-28T10:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1073009958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b5a8d3ef-74fb-4ba8-8534-476dd678fed0,host='devstack@QuobyteHD#QuobyteHD',id=8db9d9c1-aff8-46b5-9100-f578ac068bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='630a1e93e019465e9ec99c263bfef2e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:27:27Z,use_quota=True,user_id='3101a90c6ae945df9016cae60ff589ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb8a2363-157a-478d-862c-a53240f0a0a9),volume_type_id=bb8a2363-157a-478d-862c-a53240f0a0a9)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Creating volume 8db9d9c1-aff8-46b5-9100-f578ac068bb9 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:27:27 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:27 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 1073741824 Sep 28 12:27:27 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:27 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 1073741824" returned: 0 in 0.489s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:27 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 Sep 28 12:27:27 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:28 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9" returned: 0 in 0.257s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:27:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1f90a60-c032-4910-b2d1-05eb70d1d680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2378f71-aa7e-4f00-81b8-16e2d9e6adae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:27:28 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Volume volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 (8db9d9c1-aff8-46b5-9100-f578ac068bb9): created successfully Sep 28 12:27:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2378f71-aa7e-4f00-81b8-16e2d9e6adae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:27:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Flow 'volume_create_manager' (e24bf950-1d48-4aeb-a0c7-780c8ae55221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:27:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-669f5143-79b5-41fd-a321-2dc29104c5d2 tempest-GroupsTest-1730928123 None] Created volume successfully. Sep 28 12:27:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-57e062c4-514d-4692-9c74-a538c41b78c5 tempest-GroupsTest-1730928123 None] Update group completed successfully. Sep 28 12:27:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-35b9b249-321d-4645-918a-d56a69e6b6d6 tempest-GroupsTest-1730928123 None] Update group completed successfully. Sep 28 12:27:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Acquiring lock "cinder-quobyte-8db9d9c1-aff8-46b5-9100-f578ac068bb9" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Lock "cinder-quobyte-8db9d9c1-aff8-46b5-9100-f578ac068bb9" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada78d3d-13a6-47c0-b844-f5c60b97f000]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:31 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 Sep 28 12:27:31 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:31 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9" returned: 0 in 0.361s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:31 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9 Sep 28 12:27:31 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:32 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8db9d9c1-aff8-46b5-9100-f578ac068bb9" returned: 0 in 0.253s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Lock "cinder-quobyte-8db9d9c1-aff8-46b5-9100-f578ac068bb9" released by "delete_volume" :: held 0.656s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Acquiring lock "cinder-quobyte-e1c54860-f47c-4836-9fab-128970e85deb" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Lock "cinder-quobyte-e1c54860-f47c-4836-9fab-128970e85deb" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15496da-7d9b-4286-a34e-33e0b4fd7000]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:32 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb Sep 28 12:27:32 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:32 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb" returned: 0 in 0.379s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:32 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb Sep 28 12:27:32 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:32 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e1c54860-f47c-4836-9fab-128970e85deb" returned: 0 in 0.252s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Lock "cinder-quobyte-e1c54860-f47c-4836-9fab-128970e85deb" released by "delete_volume" :: held 0.671s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Created reservations ['4f48e6f9-57c1-4060-8570-d90287ea51ba'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:32 devstack cinder-volume[87048]: WARNING cinder.quota [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1997040834 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1997040834, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:27:32 devstack cinder-volume[87048]: WARNING cinder.quota [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1997040834 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1997040834, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:27:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Created reservations ['be38c231-40ba-4f67-8fde-4f875d4427d3', '642fdd4a-005e-4147-8719-a500127db6bd', 'a11cb7a1-f6d7-40dc-928c-27c2d55595a5', 'c5449914-929e-44e4-84ac-06a5ad2f3de5'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:33 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Created reservations ['8abc4498-4586-4bec-bad9-e30ed60c750a', '2383d78c-4478-4b9e-a524-06bb86e3c398', '393f4d6a-c991-4f16-808c-620b33d70905', '106b6625-030e-467c-8a20-5a7e2e4fe150'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:33 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:27:33 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:33 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.253s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:33 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ab581655-4d70-4c50-ac4f-6f0068005820 tempest-GroupsTest-1730928123 None] Delete group completed successfully. Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:38 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:27:38 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:38 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.299s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:27:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:27:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-13e22d99-e457-4d86-a036-cf3e171e05af tempest-GroupsV320Test-528565930 None] Group tempest-GroupsV320Test-Group-822740739: creating Sep 28 12:27:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-13e22d99-e457-4d86-a036-cf3e171e05af tempest-GroupsV320Test-528565930 None] Group tempest-GroupsV320Test-Group-822740739: created successfully Sep 28 12:27:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-13e22d99-e457-4d86-a036-cf3e171e05af tempest-GroupsV320Test-528565930 None] Create group completed successfully. Sep 28 12:27:40 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] Created reservations ['9eb21588-80cc-4dce-94d4-23e8fc0a393b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:27:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:27:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:27:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:27:40 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:27:40 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:27:41 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Sep 28 12:27:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.255s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:27:41 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:27:41 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-14e8dc6c-6ec8-418b-b2f3-314c33ce0b1f tempest-GroupsV320Test-528565930 None] Delete group completed successfully. Sep 28 12:27:50 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=65,cinder:SELECT=54,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:27:50 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=60,cinder:SELECT=57,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:27:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-db9a651a-c34b-4d85-b6e7-283ec6751618 req-ffd2111a-7cda-4e8b-b15b-b0b806cbf67d tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:27:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-db9a651a-c34b-4d85-b6e7-283ec6751618 req-ffd2111a-7cda-4e8b-b15b-b0b806cbf67d tempest-TestStampPattern-580264828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:27:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [req-db9a651a-c34b-4d85-b6e7-283ec6751618 req-ffd2111a-7cda-4e8b-b15b-b0b806cbf67d tempest-TestStampPattern-580264828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:27:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-db9a651a-c34b-4d85-b6e7-283ec6751618 req-ffd2111a-7cda-4e8b-b15b-b0b806cbf67d tempest-TestStampPattern-580264828 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a', 'name': 'volume-aa11bc4a-911e-466d-a6da-ac994041c1eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '64b70dab-2019-4b23-9f09-e7a0d336d0ea', 'enforce_multipath': True} {{(pid=87048) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 12:27:55 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-db9a651a-c34b-4d85-b6e7-283ec6751618 req-ffd2111a-7cda-4e8b-b15b-b0b806cbf67d tempest-TestStampPattern-580264828 None] attachment_update completed successfully. Sep 28 12:27:58 devstack cinder-volume[87048]: INFO cinder.volume.manager [req-29e93641-2d59-4ff5-94ea-9960711bc9a0 req-ba4188f6-1108-4b51-8972-53225f317a69 tempest-TestStampPattern-580264828 None] Terminate volume connection completed successfully. Sep 28 12:27:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [req-29e93641-2d59-4ff5-94ea-9960711bc9a0 req-ba4188f6-1108-4b51-8972-53225f317a69 tempest-TestStampPattern-580264828 None] Deleting attachment 64b70dab-2019-4b23-9f09-e7a0d336d0ea. {{(pid=87048) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 12:28:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Acquiring lock "cinder-aa11bc4a-911e-466d-a6da-ac994041c1eb-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Lock "cinder-aa11bc4a-911e-466d-a6da-ac994041c1eb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Acquiring lock "cinder-quobyte-aa11bc4a-911e-466d-a6da-ac994041c1eb" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-aa11bc4a-911e-466d-a6da-ac994041c1eb" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:03 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc690a0c-3861-4588-b151-1f05210c86d2]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:03 devstack sudo[103853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb Sep 28 12:28:03 devstack sudo[103853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:04 devstack sudo[103853]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb" returned: 0 in 0.400s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:04 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb Sep 28 12:28:04 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:04 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa11bc4a-911e-466d-a6da-ac994041c1eb" returned: 0 in 0.284s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-aa11bc4a-911e-466d-a6da-ac994041c1eb" released by "delete_volume" :: held 0.741s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Created reservations ['1ac4bad1-e5ca-4fd6-91f2-d5e1056169e4', 'c2c69810-17dd-415a-8761-e95df23c2102', '07d9dacf-7a9d-4d25-8886-4087dad0825f', 'e9002a95-27c3-4a16-9216-e32bb64e87d9'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:04 devstack sudo[103861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:04 devstack sudo[103861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Flow 'volume_create_manager' (312ffecf-6c1d-469c-96c2-2c4cbffe1883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3918f40c-51d1-42ba-8445-bcc2f9980d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3918f40c-51d1-42ba-8445-bcc2f9980d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-890768770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffb65a45198496799f01bab07babcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:05Z,use_quota=True,user_id='644582342ad445318a0d2b2edfb10460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e740d1b3-9247-4acf-baa6-12020bb11d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e740d1b3-9247-4acf-baa6-12020bb11d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e5d2d1-0695-435e-9fed-0d750250fe96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e5d2d1-0695-435e-9fed-0d750250fe96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e', 'volume_name': 'volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245f260e-40f0-4045-ae6d-21197c7a2380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245f260e-40f0-4045-ae6d-21197c7a2380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5c0e74-4fef-4091-a4c4-7884baa273fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:04 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Volume 9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e', 'volume_size': 1} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-890768770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ffb65a45198496799f01bab07babcc1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:05Z,use_quota=True,user_id='644582342ad445318a0d2b2edfb10460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Creating volume 9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:04 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:04 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e 1073741824 Sep 28 12:28:04 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:04 devstack sudo[103861]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.300s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Deleted volume successfully. Sep 28 12:28:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3a2a9bea-bb84-4a38-890f-6e2a01c6a2c1 tempest-TestStampPattern-580264828 None] Lock "cinder-aa11bc4a-911e-466d-a6da-ac994041c1eb-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Acquiring lock "cinder-627af43c-d7a3-4cc2-99ef-cbf687ffed58-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Lock "cinder-627af43c-d7a3-4cc2-99ef-cbf687ffed58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Acquiring lock "cinder-quobyte-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Acquiring lock "cinder-quobyte-627af43c-d7a3-4cc2-99ef-cbf687ffed58" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-627af43c-d7a3-4cc2-99ef-cbf687ffed58" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Deleting offline snapshot 627af43c-d7a3-4cc2-99ef-cbf687ffed58 of volume 05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] snapshot_file for this snap is: volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3daaceb-c998-4f02-93c9-a0d525b83e73]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:05 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 Sep 28 12:28:05 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:05 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e 1073741824" returned: 0 in 0.510s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:05 devstack sudo[103871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e Sep 28 12:28:05 devstack sudo[103871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:05 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58" returned: 0 in 0.382s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abdead0-1e39-4bd3-9b10-26d11c0fec64]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:05 devstack sudo[103871]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" returned: 0 in 0.301s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e5c0e74-4fef-4091-a4c4-7884baa273fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e916e7-132d-4950-a98a-caa9851d34dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Volume volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e (9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e): created successfully Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e916e7-132d-4950-a98a-caa9851d34dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Flow 'volume_create_manager' (312ffecf-6c1d-469c-96c2-2c4cbffe1883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:05 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-661113ff-3240-4295-b610-880461b9c729 tempest-SnapshotMetadataTestJSON-1868701738 None] Created volume successfully. Sep 28 12:28:05 devstack sudo[103877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 Sep 28 12:28:05 devstack sudo[103877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:06 devstack sudo[103877]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" returned: 0 in 0.566s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:06 devstack sudo[103882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 Sep 28 12:28:06 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:06 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58" returned: 0 in 0.346s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:06 devstack sudo[103888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58 Sep 28 12:28:06 devstack sudo[103888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:06 devstack sudo[103888]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3.627af43c-d7a3-4cc2-99ef-cbf687ffed58" returned: 0 in 0.272s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-627af43c-d7a3-4cc2-99ef-cbf687ffed58" released by "_delete_snapshot" :: held 1.682s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" released by "delete_snapshot" :: held 1.708s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Created reservations ['22146060-9c29-428b-be73-e54899651d46', 'd9e1eb76-5454-44b9-a25d-e28c9caf1d39', 'a761741b-05db-4089-8c77-c17068a6bdd4', '84bd518e-2e9b-4b5f-a1f4-bf7268f08280'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Delete snapshot completed successfully. Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Creating offline snapshot 994568f4-bf72-419f-9587-af6028896c83 of volume 9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0299df0a-c0e7-4501-b528-acaa9ce0b85e tempest-TestStampPattern-580264828 None] Lock "cinder-627af43c-d7a3-4cc2-99ef-cbf687ffed58-delete_snapshot" released by "delete_snapshot" :: held 1.898s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8597cc6-2c7d-4f96-988a-65eaaaadb84d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:07 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e Sep 28 12:28:07 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:07 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" returned: 0 in 0.391s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:07 devstack sudo[103896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 1G Sep 28 12:28:07 devstack sudo[103896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:07 devstack sudo[103896]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 1G" returned: 0 in 0.425s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:07 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 Sep 28 12:28:07 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:08 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83" returned: 0 in 0.376s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:08 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 is being set with open permissions: ugo+rw Sep 28 12:28:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:08 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 Sep 28 12:28:08 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:08 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83" returned: 0 in 0.335s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:08 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.info Sep 28 12:28:08 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:08 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.info" returned: 0 in 0.401s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:08 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.info is being set with open permissions: ugo+rw Sep 28 12:28:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:08 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.info Sep 28 12:28:08 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:09 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.info" returned: 0 in 0.271s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.322s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:09 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-586ee96f-c024-4dfa-86bb-a3e07426b520 tempest-SnapshotMetadataTestJSON-1868701738 None] Create snapshot completed successfully Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Acquiring lock "cinder-994568f4-bf72-419f-9587-af6028896c83-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-994568f4-bf72-419f-9587-af6028896c83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Acquiring lock "cinder-quobyte-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-quobyte-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Acquiring lock "cinder-quobyte-994568f4-bf72-419f-9587-af6028896c83" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-quobyte-994568f4-bf72-419f-9587-af6028896c83" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Deleting offline snapshot 994568f4-bf72-419f-9587-af6028896c83 of volume 9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] snapshot_file for this snap is: volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Acquiring lock "cinder-05e04946-1ed9-4b74-bd74-b7373a5c9ab3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[41967e01-ce0f-45b3-a2da-9bef1c7bc8c9]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Lock "cinder-05e04946-1ed9-4b74-bd74-b7373a5c9ab3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Acquiring lock "cinder-quobyte-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab628f73-c297-47ad-a217-305fb85b20fb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:10 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 Sep 28 12:28:10 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:11 devstack sudo[103950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 Sep 28 12:28:11 devstack sudo[103950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:11 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83" returned: 0 in 0.399s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f976f83f-d702-412b-a9b1-dc2e71ce13c1]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:11 devstack sudo[103950]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" returned: 0 in 0.407s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:11 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e Sep 28 12:28:11 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:11 devstack sudo[103960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3 Sep 28 12:28:11 devstack sudo[103960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:11 devstack sudo[103960]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" returned: 0 in 0.254s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Lock "cinder-quobyte-05e04946-1ed9-4b74-bd74-b7373a5c9ab3" released by "delete_volume" :: held 0.734s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:11 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" returned: 0 in 0.380s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:11 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 Sep 28 12:28:11 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Created reservations ['3a46035f-7aae-4980-b5bd-b34fe35e281e', 'b22b64ac-ee62-4372-8dac-e5642cda6a38', '9c664392-a05c-47ba-970c-0e0fdcfdd7aa', '6bf0eaed-877b-4a4f-a3a0-97b5396115b8'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:11 devstack sudo[103969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:11 devstack sudo[103969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:12 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83" returned: 0 in 0.365s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:12 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83 Sep 28 12:28:12 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:12 devstack sudo[103969]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.267s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Deleted volume successfully. Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-00f8bdfe-3615-44cc-afe8-af57848ecde3 tempest-TestStampPattern-580264828 None] Lock "cinder-05e04946-1ed9-4b74-bd74-b7373a5c9ab3-delete_volume" released by "delete_volume" :: held 1.237s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:12 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e.994568f4-bf72-419f-9587-af6028896c83" returned: 0 in 0.294s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-quobyte-994568f4-bf72-419f-9587-af6028896c83" released by "_delete_snapshot" :: held 1.558s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-quobyte-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" released by "delete_snapshot" :: held 1.581s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Created reservations ['d8a1d0cb-1e84-4c46-a55c-4bdd2e6e7c52', 'c130afb2-54da-40fa-98a0-97d89c62e481', '22ce73da-e7d0-4839-bfb3-5cba5c89fa1a', 'a04546c7-253f-4593-858a-a9daca817685'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Delete snapshot completed successfully. Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0c2d615f-825a-463b-b46d-ef6024d73677 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-994568f4-bf72-419f-9587-af6028896c83-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Acquiring lock "cinder-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Acquiring lock "cinder-quobyte-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-quobyte-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c7e43b-f934-4ef9-914d-53ff978065a3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:13 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e Sep 28 12:28:13 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:13 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" returned: 0 in 0.392s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:13 devstack sudo[103983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e Sep 28 12:28:13 devstack sudo[103983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:13 devstack sudo[103983]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" returned: 0 in 0.273s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-quobyte-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e" released by "delete_volume" :: held 0.740s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Created reservations ['63ac21cb-eca1-43af-bca4-644ea81f3055', 'b7ab66de-bc7e-4847-a2c7-f22050c50519', '6c8ac467-3a4f-43c5-a493-224d610b0056', 'cbe54d3b-003c-41dd-9e75-64aa1336e0f3'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:13 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:13 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:14 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.272s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:14 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:14 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Deleted volume successfully. Sep 28 12:28:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f5262f6f-35e1-4a53-9cef-b5670553ddf5 tempest-SnapshotMetadataTestJSON-1868701738 None] Lock "cinder-9d2b2a02-90ce-44f1-bc93-e69b9ed3e66e-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:17 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Flow 'volume_create_manager' (795e2032-3ecf-4c25-9576-ea18bf2d1127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3360c8-081e-495a-852d-4b709efe1019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b3360c8-081e-495a-852d-4b709efe1019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-75303706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e78bfc-4cda-49c7-a0ac-2064ad82d46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94468cf800ed4515b4182b23b7eb0072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:18Z,use_quota=True,user_id='2b2e2846f96749449acd912e13957780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084343e5-f4a4-4f30-822b-5ac2b919f217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084343e5-f4a4-4f30-822b-5ac2b919f217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b59a58-bbeb-403a-ae68-3acc8ffd5d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b59a58-bbeb-403a-ae68-3acc8ffd5d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e78bfc-4cda-49c7-a0ac-2064ad82d46b', 'volume_name': 'volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a5b75f-af51-4a59-9347-604ecb5c5d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24a5b75f-af51-4a59-9347-604ecb5c5d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe64b9c8-0586-4d69-b5a4-72411d5a88f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Volume 22e78bfc-4cda-49c7-a0ac-2064ad82d46b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b', 'volume_size': 1} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-75303706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e78bfc-4cda-49c7-a0ac-2064ad82d46b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94468cf800ed4515b4182b23b7eb0072',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:18Z,use_quota=True,user_id='2b2e2846f96749449acd912e13957780',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Creating volume 22e78bfc-4cda-49c7-a0ac-2064ad82d46b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:18 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:18 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b 1073741824 Sep 28 12:28:18 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:18 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b 1073741824" returned: 0 in 0.481s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:18 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b Sep 28 12:28:18 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:18 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b" returned: 0 in 0.268s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe64b9c8-0586-4d69-b5a4-72411d5a88f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05580dcc-bb66-4982-adb1-6c566f062733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Volume volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b (22e78bfc-4cda-49c7-a0ac-2064ad82d46b): created successfully Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05580dcc-bb66-4982-adb1-6c566f062733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Flow 'volume_create_manager' (795e2032-3ecf-4c25-9576-ea18bf2d1127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:18 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e31513e1-9672-4d98-a46e-0d8b8d35a98c tempest-VolumesMetadataTest-442836450 None] Created volume successfully. Sep 28 12:28:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Acquiring lock "cinder-22e78bfc-4cda-49c7-a0ac-2064ad82d46b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Lock "cinder-22e78bfc-4cda-49c7-a0ac-2064ad82d46b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Acquiring lock "cinder-quobyte-22e78bfc-4cda-49c7-a0ac-2064ad82d46b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Lock "cinder-quobyte-22e78bfc-4cda-49c7-a0ac-2064ad82d46b" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[603683a9-9d0c-4162-9657-dee8380edeec]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:21 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b Sep 28 12:28:21 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:21 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b" returned: 0 in 0.421s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:21 devstack sudo[104010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b Sep 28 12:28:21 devstack sudo[104010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:21 devstack sudo[104010]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-22e78bfc-4cda-49c7-a0ac-2064ad82d46b" returned: 0 in 0.255s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Lock "cinder-quobyte-22e78bfc-4cda-49c7-a0ac-2064ad82d46b" released by "delete_volume" :: held 0.724s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Created reservations ['2dad0253-0d95-409f-95a8-a8c59f87d490', 'd20cd43e-04f9-4e81-a5ee-412a7af8138a', '1541ecd4-0663-4355-85f3-efd2ee9c38ea', '79de5b16-1c35-4d4a-a50a-c5fac0ecce4a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:21 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:21 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:22 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.283s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:22 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Deleted volume successfully. Sep 28 12:28:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-309ae81d-199f-42c4-89b2-b8686fef1952 tempest-VolumesMetadataTest-442836450 None] Lock "cinder-22e78bfc-4cda-49c7-a0ac-2064ad82d46b-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Flow 'volume_create_manager' (10cf1360-9c4d-4faa-b23a-57ed50fc0b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c24d16e-7c84-4669-ae54-72d29122e2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c24d16e-7c84-4669-ae54-72d29122e2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-149373997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54603b97-4edf-4e7e-93f7-0f8ac3670d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a4d3404a3040848c4439fd45c9dce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:27Z,use_quota=True,user_id='d1db16be483f44a888fb78f94a25e32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451f758d-1afb-4822-9db8-b0b67546202a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (451f758d-1afb-4822-9db8-b0b67546202a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8babf48-10df-4936-88d7-6162b537358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8babf48-10df-4936-88d7-6162b537358c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54603b97-4edf-4e7e-93f7-0f8ac3670d73', 'volume_name': 'volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8455ffae-5d89-4180-b13c-1e1e9850a9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8455ffae-5d89-4180-b13c-1e1e9850a9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fc4223-dabb-4a32-8688-589ecd02100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:27 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Volume 54603b97-4edf-4e7e-93f7-0f8ac3670d73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73', 'volume_size': 1} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-149373997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54603b97-4edf-4e7e-93f7-0f8ac3670d73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a4d3404a3040848c4439fd45c9dce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:27Z,use_quota=True,user_id='d1db16be483f44a888fb78f94a25e32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Creating volume 54603b97-4edf-4e7e-93f7-0f8ac3670d73 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:27 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:27 devstack sudo[104017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 1073741824 Sep 28 12:28:27 devstack sudo[104017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:28 devstack sudo[104017]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 1073741824" returned: 0 in 0.454s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:28 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 Sep 28 12:28:28 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Flow 'volume_create_manager' (d2b2bf6e-aafb-446d-a19a-50c228e39718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d11687-f42e-457a-acaf-9fdc411791f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17d11687-f42e-457a-acaf-9fdc411791f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d1772b-71b6-4d5e-b5a8-346e8eff75c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557283a67bc940dc96d6c3524dbb98f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:28Z,use_quota=True,user_id='289b7529bb8d4469ab27371d930436e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd9cb826-644e-473d-bfda-a102048d05d5),volume_type_id=dd9cb826-644e-473d-bfda-a102048d05d5)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c056bec-9843-4832-a2df-6dfbb2e52046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c056bec-9843-4832-a2df-6dfbb2e52046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d84765b-99f3-4bcd-b261-ece2403793b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:28:28 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73" returned: 0 in 0.267s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fc4223-dabb-4a32-8688-589ecd02100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b6bbd3-9056-4b7b-a083-bc8329b8018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:28 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Volume volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 (54603b97-4edf-4e7e-93f7-0f8ac3670d73): created successfully Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66b6bbd3-9056-4b7b-a083-bc8329b8018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Flow 'volume_create_manager' (10cf1360-9c4d-4faa-b23a-57ed50fc0b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-104db460-649a-49c7-8252-9c9ef105b71a tempest-VolumesTransfersV357Test-774124564 None] Created volume successfully. Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d84765b-99f3-4bcd-b261-ece2403793b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e4d1772b-71b6-4d5e-b5a8-346e8eff75c1', 'volume_name': 'volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1', 'volume_size': 1, 'image_id': 'bef1f2f6-2c99-457e-ba6d-7be974defec6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bef1f2f6-2c99-457e-ba6d-7be974defec6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99fd583f2c9571819b7f6d598b77fb3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '557283a67bc940dc96d6c3524dbb98f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1160523a0ca2a73ea045eadbe06bc091ea6381a97b5f624a861c39ecd9a85a154c836af691c5eddc5f888a81ea073822d4041883d61bc4c1e0527c004ea9ddf3', 'id': 'bef1f2f6-2c99-457e-ba6d-7be974defec6', 'created_at': datetime.datetime(2026, 9, 28, 10, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bef1f2f6-2c99-457e-ba6d-7be974defec6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0f87fb-533f-40d3-8d3f-992c0adb8749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f0f87fb-533f-40d3-8d3f-992c0adb8749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d37cd64-3c4f-4402-b180-1a89b0bb6b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:28 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Volume e4d1772b-71b6-4d5e-b5a8-346e8eff75c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1', 'volume_size': 1, 'image_id': 'bef1f2f6-2c99-457e-ba6d-7be974defec6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bef1f2f6-2c99-457e-ba6d-7be974defec6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99fd583f2c9571819b7f6d598b77fb3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '557283a67bc940dc96d6c3524dbb98f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1160523a0ca2a73ea045eadbe06bc091ea6381a97b5f624a861c39ecd9a85a154c836af691c5eddc5f888a81ea073822d4041883d61bc4c1e0527c004ea9ddf3', 'id': 'bef1f2f6-2c99-457e-ba6d-7be974defec6', 'created_at': datetime.datetime(2026, 9, 28, 10, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bef1f2f6-2c99-457e-ba6d-7be974defec6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Trying to clone e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 from image bef1f2f6-2c99-457e-ba6d-7be974defec6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bef1f2f6-2c99-457e-ba6d-7be974defec6', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:28:28 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[230ba69a-83da-457c-855b-c1e6246b652c]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:28 devstack sudo[104026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD Sep 28 12:28:28 devstack sudo[104026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:29 devstack sudo[104026]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD" returned: 0 in 0.349s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:29 devstack sudo[104030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD Sep 28 12:28:29 devstack sudo[104030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-47cb0f82-3046-4e53-abbc-135a9257a975 tempest-VolumesTransfersV357Test-1608968388 None] Transfer volume completed successfully. Sep 28 12:28:29 devstack sudo[104030]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD" returned: 1 in 0.361s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Temporary image bef1f2f6-2c99-457e-ba6d-7be974defec6 is fetched for user 289b7529bb8d4469ab27371d930436e8. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de8f529-2389-423b-85e3-cc5dbe4ad17f]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:29 devstack sudo[104036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD Sep 28 12:28:29 devstack sudo[104036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Acquiring lock "cinder-54603b97-4edf-4e7e-93f7-0f8ac3670d73-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Lock "cinder-54603b97-4edf-4e7e-93f7-0f8ac3670d73-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Acquiring lock "cinder-quobyte-54603b97-4edf-4e7e-93f7-0f8ac3670d73" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Lock "cinder-quobyte-54603b97-4edf-4e7e-93f7-0f8ac3670d73" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:29 devstack sudo[104036]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3073793a-5e0d-42c9-a8c6-5aa9f88b73fe]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:29 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD Sep 28 12:28:29 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:30 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 Sep 28 12:28:30 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:30 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d1772b-71b6-4d5e-b5a8-346e8eff75c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557283a67bc940dc96d6c3524dbb98f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:28Z,use_quota=True,user_id='289b7529bb8d4469ab27371d930436e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dd9cb826-644e-473d-bfda-a102048d05d5),volume_type_id=dd9cb826-644e-473d-bfda-a102048d05d5)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Creating volume e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:30 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:30 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73" returned: 0 in 0.379s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:30 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 1073741824 Sep 28 12:28:30 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:30 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73 Sep 28 12:28:30 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:30 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-54603b97-4edf-4e7e-93f7-0f8ac3670d73" returned: 0 in 0.273s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Lock "cinder-quobyte-54603b97-4edf-4e7e-93f7-0f8ac3670d73" released by "delete_volume" :: held 0.708s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Created reservations ['dee44bc7-c7fa-44ad-abbb-dc336e5cb375', 'c4857a30-d814-4669-9455-efde79542828', 'd8510c13-955a-480a-8e09-7c6fef396ebe', '384d691b-45fb-4f12-812e-ac2fa14c9fc7'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:30 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:30 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:30 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 1073741824" returned: 0 in 0.473s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:30 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 Sep 28 12:28:30 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:30 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:30 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:30 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Deleted volume successfully. Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4925e47a-d11a-4af2-82df-b58ef2be803f tempest-VolumesTransfersV357Test-1367236450 None] Lock "cinder-54603b97-4edf-4e7e-93f7-0f8ac3670d73-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:31 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1" returned: 0 in 0.273s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Attempting download of bef1f2f6-2c99-457e-ba6d-7be974defec6 ((None, [{'url': 'file:///opt/stack/data/glance/images/bef1f2f6-2c99-457e-ba6d-7be974defec6', 'metadata': {}}])) to volume e4d1772b-71b6-4d5e-b5a8-346e8eff75c1. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57a648f-1ee0-4ffa-b5c7-49b3457d144a]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bef1f2f6-2c99-457e-ba6d-7be974defec6_18mol3v4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:31 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bef1f2f6-2c99-457e-ba6d-7be974defec6_18mol3v4 Sep 28 12:28:31 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:31 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Flow 'volume_create_manager' (86a22e54-2910-4614-b8a7-0cf805cb915b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b93bc9-d9c1-4d21-86b5-7a0f50cb06cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bef1f2f6-2c99-457e-ba6d-7be974defec6_18mol3v4" returned: 0 in 0.390s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bef1f2f6-2c99-457e-ba6d-7be974defec6_18mol3v4 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49b93bc9-d9c1-4d21-86b5-7a0f50cb06cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-864045249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e311a7d7-9552-455a-8a24-6604058a267c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a4d3404a3040848c4439fd45c9dce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:31Z,use_quota=True,user_id='d1db16be483f44a888fb78f94a25e32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba1ed39-a30c-4f20-aeee-cff6b916d548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba1ed39-a30c-4f20-aeee-cff6b916d548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0716bce3-4e5c-40ab-b5dc-4e3738a92dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0716bce3-4e5c-40ab-b5dc-4e3738a92dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e311a7d7-9552-455a-8a24-6604058a267c', 'volume_name': 'volume-e311a7d7-9552-455a-8a24-6604058a267c', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3130f355-018b-4a14-8536-d483393d0f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3130f355-018b-4a14-8536-d483393d0f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8a2101-5664-4bd1-aec8-439df14e54cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:31 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Volume e311a7d7-9552-455a-8a24-6604058a267c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e311a7d7-9552-455a-8a24-6604058a267c', 'volume_size': 1} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-864045249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e311a7d7-9552-455a-8a24-6604058a267c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a4d3404a3040848c4439fd45c9dce8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:31Z,use_quota=True,user_id='d1db16be483f44a888fb78f94a25e32f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Creating volume e311a7d7-9552-455a-8a24-6604058a267c {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:31 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:31 devstack sudo[104070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c 1073741824 Sep 28 12:28:31 devstack sudo[104070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:31 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bef1f2f6-2c99-457e-ba6d-7be974defec6_18mol3v4 Sep 28 12:28:31 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:31 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bef1f2f6-2c99-457e-ba6d-7be974defec6_18mol3v4" returned: 1 in 0.352s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bef1f2f6-2c99-457e-ba6d-7be974defec6_18mol3v4' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddf62f8-3345-4593-be4c-e23f0812d329]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:31 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD Sep 28 12:28:31 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:32 devstack sudo[104070]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c 1073741824" returned: 0 in 0.495s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:32 devstack sudo[104081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c Sep 28 12:28:32 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:32 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:32 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD Sep 28 12:28:32 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:32 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c" returned: 0 in 0.272s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c8a2101-5664-4bd1-aec8-439df14e54cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e311a7d7-9552-455a-8a24-6604058a267c', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91a679c-d984-4702-92b8-06ad06d4d653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:32 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Volume volume-e311a7d7-9552-455a-8a24-6604058a267c (e311a7d7-9552-455a-8a24-6604058a267c): created successfully Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91a679c-d984-4702-92b8-06ad06d4d653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Flow 'volume_create_manager' (86a22e54-2910-4614-b8a7-0cf805cb915b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:32 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1513c4f9-f6ce-4936-8bd1-09a489c78710 tempest-VolumesTransfersV357Test-774124564 None] Created volume successfully. Sep 28 12:28:32 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] bef1f2f6-2c99-457e-ba6d-7be974defec6 was raw, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:28:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:32 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 Sep 28 12:28:32 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:33 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1" returned: 0 in 0.442s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bef1f2f6-2c99-457e-ba6d-7be974defec6_0id4lb69devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:28:33 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:33 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 1G Sep 28 12:28:33 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:33 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 1G" returned: 0 in 0.322s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Downloaded image bef1f2f6-2c99-457e-ba6d-7be974defec6 ((None, [{'url': 'file:///opt/stack/data/glance/images/bef1f2f6-2c99-457e-ba6d-7be974defec6', 'metadata': {}}])) to volume e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Temporary image bef1f2f6-2c99-457e-ba6d-7be974defec6 for user 289b7529bb8d4469ab27371d930436e8 is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Marking volume e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Copying metadata from image bef1f2f6-2c99-457e-ba6d-7be974defec6 to e4d1772b-71b6-4d5e-b5a8-346e8eff75c1. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Creating volume glance metadata for volume e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 backed by image bef1f2f6-2c99-457e-ba6d-7be974defec6 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'bef1f2f6-2c99-457e-ba6d-7be974defec6', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '99fd583f2c9571819b7f6d598b77fb3e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d37cd64-3c4f-4402-b180-1a89b0bb6b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1', 'volume_size': 1, 'image_id': 'bef1f2f6-2c99-457e-ba6d-7be974defec6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bef1f2f6-2c99-457e-ba6d-7be974defec6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '99fd583f2c9571819b7f6d598b77fb3e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '557283a67bc940dc96d6c3524dbb98f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1160523a0ca2a73ea045eadbe06bc091ea6381a97b5f624a861c39ecd9a85a154c836af691c5eddc5f888a81ea073822d4041883d61bc4c1e0527c004ea9ddf3', 'id': 'bef1f2f6-2c99-457e-ba6d-7be974defec6', 'created_at': datetime.datetime(2026, 9, 28, 10, 28, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 28, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bef1f2f6-2c99-457e-ba6d-7be974defec6/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d4ed89-55e8-49c3-8b64-12e7d558b8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:33 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Volume volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 (e4d1772b-71b6-4d5e-b5a8-346e8eff75c1): created successfully Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00d4ed89-55e8-49c3-8b64-12e7d558b8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Flow 'volume_create_manager' (d2b2bf6e-aafb-446d-a19a-50c228e39718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a7dcd9ae-8d48-410c-b2ae-a0c91494e9ef tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Created volume successfully. Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Acquiring lock "cinder-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "cinder-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Acquiring lock "cinder-quobyte-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "cinder-quobyte-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1" acquired by "delete_volume" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e9a2fc-34be-48e9-867b-6c9f3988945a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:33 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 Sep 28 12:28:33 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Acquiring lock "cinder-e311a7d7-9552-455a-8a24-6604058a267c-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Lock "cinder-e311a7d7-9552-455a-8a24-6604058a267c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Acquiring lock "cinder-quobyte-e311a7d7-9552-455a-8a24-6604058a267c" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Lock "cinder-quobyte-e311a7d7-9552-455a-8a24-6604058a267c" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b49f09b-0eb7-4240-9057-b7d0327c0179]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:34 devstack sudo[104103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c Sep 28 12:28:34 devstack sudo[104103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:34 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1" returned: 0 in 0.418s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:34 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1 Sep 28 12:28:34 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:34 devstack sudo[104103]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c" returned: 0 in 0.375s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:34 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c Sep 28 12:28:34 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:34 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1" returned: 0 in 0.257s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "cinder-quobyte-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1" released by "delete_volume" :: held 0.731s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:34 devstack cinder-volume[87048]: WARNING cinder.quota [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:28:34 devstack cinder-volume[87048]: WARNING cinder.quota [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Created reservations ['2765d4c4-3aca-4940-a679-78c847cbd544', '4226efb3-7791-4dc3-9fca-50c3ba405f11', '94cc19d6-5413-4be6-b241-80d4d5d7efa9', 'f65cd5d6-0016-4e45-9b03-0eadad9a4c81'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:34 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:34 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:34 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e311a7d7-9552-455a-8a24-6604058a267c" returned: 0 in 0.262s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Lock "cinder-quobyte-e311a7d7-9552-455a-8a24-6604058a267c" released by "delete_volume" :: held 0.685s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Created reservations ['8fa84db7-97f8-443c-8bcf-1afbfaf37496', 'e4b68e1d-f6e3-4b78-9218-2061eb21fe67', '610bdada-fb53-4e07-aa5b-28f884c56316', 'e4c791fb-2245-4c30-b89d-72e3321eae70'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:34 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.266s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Deleted volume successfully. Sep 28 12:28:34 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:34 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-177ad582-f2b2-427a-8d96-1c30c10f85da tempest-VolumeAndVolumeTypeFromImageTest-1480901852 None] Lock "cinder-e4d1772b-71b6-4d5e-b5a8-346e8eff75c1-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:35 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.271s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:35 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Deleted volume successfully. Sep 28 12:28:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-44098372-f802-44c7-81ed-3fcda13216d0 tempest-VolumesTransfersV357Test-1367236450 None] Lock "cinder-e311a7d7-9552-455a-8a24-6604058a267c-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:38 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:38 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:38 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.312s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:28:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (2b4f63f2-2cc8-4796-94b4-8ae6709740f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91eac4d-7a8e-4de8-b430-15efaa18ede2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91eac4d-7a8e-4de8-b430-15efaa18ede2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453679254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b428635b-af22-4c41-9327-b45e5c281c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:40Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56235ccc-f8f5-42e9-b240-156f47e73996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56235ccc-f8f5-42e9-b240-156f47e73996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b174563-5cd5-4584-8d41-f540e937433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b174563-5cd5-4584-8d41-f540e937433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b428635b-af22-4c41-9327-b45e5c281c70', 'volume_name': 'volume-b428635b-af22-4c41-9327-b45e5c281c70', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171bcc14-5eeb-46ff-86b7-bb1123c7a966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171bcc14-5eeb-46ff-86b7-bb1123c7a966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b6e164-96a2-4145-9d9b-f43517994511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:40 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume b428635b-af22-4c41-9327-b45e5c281c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b428635b-af22-4c41-9327-b45e5c281c70', 'volume_size': 1} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453679254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b428635b-af22-4c41-9327-b45e5c281c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:40Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Creating volume b428635b-af22-4c41-9327-b45e5c281c70 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:40 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:40 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 1073741824 Sep 28 12:28:40 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:40 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 1073741824" returned: 0 in 0.469s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:40 devstack sudo[104135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 Sep 28 12:28:40 devstack sudo[104135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:40 devstack sudo[104135]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70" returned: 0 in 0.301s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b6e164-96a2-4145-9d9b-f43517994511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b428635b-af22-4c41-9327-b45e5c281c70', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0994fea-2dee-4d61-bf7b-cb2e3f857c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:41 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume volume-b428635b-af22-4c41-9327-b45e5c281c70 (b428635b-af22-4c41-9327-b45e5c281c70): created successfully Sep 28 12:28:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0994fea-2dee-4d61-bf7b-cb2e3f857c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (2b4f63f2-2cc8-4796-94b4-8ae6709740f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:41 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e079cb0c-d2c5-42ae-8aec-06d5344612a3 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created volume successfully. Sep 28 12:28:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Creating offline snapshot d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d of volume b428635b-af22-4c41-9327-b45e5c281c70 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:28:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7495600-533c-45ae-9894-dd9999745492]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:42 devstack sudo[104138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 Sep 28 12:28:42 devstack sudo[104138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:42 devstack sudo[104138]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70" returned: 0 in 0.381s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:42 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d 1G Sep 28 12:28:42 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:43 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d 1G" returned: 0 in 0.443s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b428635b-af22-4c41-9327-b45e5c281c70 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:43 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b428635b-af22-4c41-9327-b45e5c281c70 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d Sep 28 12:28:43 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:43 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b428635b-af22-4c41-9327-b45e5c281c70 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d" returned: 0 in 0.300s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:43 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d is being set with open permissions: ugo+rw Sep 28 12:28:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:43 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d Sep 28 12:28:43 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:43 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d" returned: 0 in 0.271s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:43 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.info Sep 28 12:28:43 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:44 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.info" returned: 0 in 0.294s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:44 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.info is being set with open permissions: ugo+rw Sep 28 12:28:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:44 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.info Sep 28 12:28:44 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:44 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.info" returned: 0 in 0.292s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7e8cd3d7-41a3-4d01-9ebb-3d1f8f19efc9 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Create snapshot completed successfully Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (b9819aa7-6e26-4d1d-bc6d-cc4e4c2620f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9731f4-5347-453e-8792-3ac9c71e2ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa9731f4-5347-453e-8792-3ac9c71e2ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-94441589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:46Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36b2153-bfd7-452d-a1c1-1d5f301fb763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36b2153-bfd7-452d-a1c1-1d5f301fb763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cf0386-baa6-4ff1-927c-1d52653e4421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cf0386-baa6-4ff1-927c-1d52653e4421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1', 'volume_name': 'volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64780129-3491-4944-b475-e6c9333a4ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64780129-3491-4944-b475-e6c9333a4ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee6b21a-a480-45bc-97d6-83e26f7246ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1', 'volume_size': 1} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-94441589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:46Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Creating volume cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:46 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:46 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 1073741824 Sep 28 12:28:46 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (1d236f63-54b7-4e69-8ebc-705fd711e494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae0956b-949d-4a53-9d21-9cc8ea7cd44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ae0956b-949d-4a53-9d21-9cc8ea7cd44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1348421953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce943c6-420a-4b47-9994-7ff766a673ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:47Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5076894-cdd9-479d-a4db-b6c8241536e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5076894-cdd9-479d-a4db-b6c8241536e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f25265b1-369c-43f0-a3b4-17a6dc020327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f25265b1-369c-43f0-a3b4-17a6dc020327) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ce943c6-420a-4b47-9994-7ff766a673ba', 'volume_name': 'volume-8ce943c6-420a-4b47-9994-7ff766a673ba', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dd31ba-8669-40df-b402-d7bef82222cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dd31ba-8669-40df-b402-d7bef82222cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f02e4e-8d63-43d2-963c-c2737899b757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:46 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume 8ce943c6-420a-4b47-9994-7ff766a673ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ce943c6-420a-4b47-9994-7ff766a673ba', 'volume_size': 1} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:46 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 1073741824" returned: 0 in 0.651s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:47 devstack sudo[104167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 Sep 28 12:28:47 devstack sudo[104167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (d9102198-7146-4494-b265-11b8e971eaee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac1a345-39af-4372-9599-a6aaa129fda7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cac1a345-39af-4372-9599-a6aaa129fda7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1978154989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d2a721-a7d8-404a-a901-3bf98dbe6080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:47Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b78834a-d597-42d2-a68c-9752a699ccfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b78834a-d597-42d2-a68c-9752a699ccfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d169f91-2d69-41d1-9609-cd9a045cb512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d169f91-2d69-41d1-9609-cd9a045cb512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d2a721-a7d8-404a-a901-3bf98dbe6080', 'volume_name': 'volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318fd58c-739f-4a27-993f-31c3313d1c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318fd58c-739f-4a27-993f-31c3313d1c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4b749a-5837-4c58-ad68-be49f429cb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume b9d2a721-a7d8-404a-a901-3bf98dbe6080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080', 'volume_size': 1} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:47 devstack sudo[104167]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1" returned: 0 in 0.438s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.698s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1348421953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ce943c6-420a-4b47-9994-7ff766a673ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:47Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Creating volume 8ce943c6-420a-4b47-9994-7ff766a673ba {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:47 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee6b21a-a480-45bc-97d6-83e26f7246ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a3a804-e6a3-4a17-bf78-b7a2e8aeb4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba 1073741824 Sep 28 12:28:47 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:47 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 (cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1): created successfully Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a3a804-e6a3-4a17-bf78-b7a2e8aeb4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (b9819aa7-6e26-4d1d-bc6d-cc4e4c2620f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:47 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c401b921-76de-4340-be5f-c0140b03443b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created volume successfully. Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (4d1c16b9-225c-408e-990a-d8d1f00ff00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e44d99d-327b-4964-a239-087e1cc8821c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e44d99d-327b-4964-a239-087e1cc8821c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864761675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:48Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ae025d-7040-4fd4-9d61-e631671592b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ae025d-7040-4fd4-9d61-e631671592b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e26625e-3a82-476c-9fdb-7f37ec07d1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e26625e-3a82-476c-9fdb-7f37ec07d1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904', 'volume_name': 'volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71bde27-198f-4e60-a312-fcf2be69209f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a71bde27-198f-4e60-a312-fcf2be69209f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e5c8b7-cb7a-4b2d-93bb-2b7ae0fbdafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:47 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904', 'volume_size': 1} Sep 28 12:28:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:48 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba 1073741824" returned: 0 in 0.824s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:48 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba Sep 28 12:28:48 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (39a55c98-e07a-4f46-b7db-dd757116ceef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db223625-2382-4f1d-88ae-b33738904751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db223625-2382-4f1d-88ae-b33738904751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-783398403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8a23e0-79b3-499f-8c47-eff192eb7957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:48Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e8bc86-2f00-4438-af64-4e44361e6e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4e8bc86-2f00-4438-af64-4e44361e6e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75db0a92-1f7b-4157-868f-5e2f0bff5a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75db0a92-1f7b-4157-868f-5e2f0bff5a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8a23e0-79b3-499f-8c47-eff192eb7957', 'volume_name': 'volume-5f8a23e0-79b3-499f-8c47-eff192eb7957', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97313b7-eb05-43f1-9f0c-9c3462f90be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e97313b7-eb05-43f1-9f0c-9c3462f90be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891e0674-1b3f-4301-bfa8-334af77ae300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:48 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume 5f8a23e0-79b3-499f-8c47-eff192eb7957: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8a23e0-79b3-499f-8c47-eff192eb7957', 'volume_size': 1} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:48 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba" returned: 0 in 0.303s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.492s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1978154989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d2a721-a7d8-404a-a901-3bf98dbe6080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:47Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Creating volume b9d2a721-a7d8-404a-a901-3bf98dbe6080 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:48 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f02e4e-8d63-43d2-963c-c2737899b757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ce943c6-420a-4b47-9994-7ff766a673ba', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:48 devstack sudo[104179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 1073741824 Sep 28 12:28:48 devstack sudo[104179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e153ee9-8e8b-4eb4-aa45-87b54d7ee1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:48 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume volume-8ce943c6-420a-4b47-9994-7ff766a673ba (8ce943c6-420a-4b47-9994-7ff766a673ba): created successfully Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e153ee9-8e8b-4eb4-aa45-87b54d7ee1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (1d236f63-54b7-4e69-8ebc-705fd711e494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-77c85d39-62f7-4697-bd30-ada8e94f774b tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created volume successfully. Sep 28 12:28:49 devstack sudo[104179]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 1073741824" returned: 0 in 0.580s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:49 devstack sudo[104186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 Sep 28 12:28:49 devstack sudo[104186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:49 devstack sudo[104186]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080" returned: 0 in 0.299s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1864761675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:48Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Creating volume a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:49 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a4b749a-5837-4c58-ad68-be49f429cb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:49 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 1073741824 Sep 28 12:28:49 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0b45a6-d73e-4be1-8178-9d47644c40bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:49 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 (b9d2a721-a7d8-404a-a901-3bf98dbe6080): created successfully Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0b45a6-d73e-4be1-8178-9d47644c40bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (d9102198-7146-4494-b265-11b8e971eaee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9c740908-3dd6-4560-9c22-1dfaad11c760 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created volume successfully. Sep 28 12:28:50 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 1073741824" returned: 0 in 0.519s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:50 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 Sep 28 12:28:50 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:50 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904" returned: 0 in 0.275s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.876s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-783398403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8a23e0-79b3-499f-8c47-eff192eb7957,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cebb17ec343f44088a9308d8a3ef4913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:48Z,use_quota=True,user_id='f92b26630ff34117b683a8ec3b9ab6b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Creating volume 5f8a23e0-79b3-499f-8c47-eff192eb7957 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:50 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e5c8b7-cb7a-4b2d-93bb-2b7ae0fbdafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288316e1-eecc-496a-8df2-f0732c4697d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:50 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 1073741824 Sep 28 12:28:50 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:50 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 (a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904): created successfully Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (288316e1-eecc-496a-8df2-f0732c4697d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (4d1c16b9-225c-408e-990a-d8d1f00ff00c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:50 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5d8a5c48-0e85-486d-8454-170144c908c2 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created volume successfully. Sep 28 12:28:51 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 1073741824" returned: 0 in 0.639s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=95,cinder:UPDATE=105,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=82,cinder:UPDATE=103,cinder:INSERT=27,cinder:DELETE=9 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:51 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 Sep 28 12:28:51 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:51 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957" returned: 0 in 0.283s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891e0674-1b3f-4301-bfa8-334af77ae300) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8a23e0-79b3-499f-8c47-eff192eb7957', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e04703-a723-4f06-8386-5ac9d0217dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:51 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Volume volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 (5f8a23e0-79b3-499f-8c47-eff192eb7957): created successfully Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e04703-a723-4f06-8386-5ac9d0217dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Flow 'volume_create_manager' (39a55c98-e07a-4f46-b7db-dd757116ceef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-afdacb3a-90d4-41bc-8eb3-e7cbcf73d35d tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created volume successfully. Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-5f8a23e0-79b3-499f-8c47-eff192eb7957-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-5f8a23e0-79b3-499f-8c47-eff192eb7957-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-quobyte-5f8a23e0-79b3-499f-8c47-eff192eb7957" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-5f8a23e0-79b3-499f-8c47-eff192eb7957" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee57259-189f-4a52-b558-01c6ba6e6d6a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:52 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 Sep 28 12:28:52 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:52 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957" returned: 0 in 0.381s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:52 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957 Sep 28 12:28:52 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:52 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Flow 'volume_create_manager' (3bd12e2e-a81b-4a2e-9018-6d45f6578cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9a08c6-8159-4460-bb4e-b15144beaf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5f8a23e0-79b3-499f-8c47-eff192eb7957" returned: 0 in 0.307s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9a08c6-8159-4460-bb4e-b15144beaf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2123130881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942931b4-6a53-490e-a239-7aae4e5e7c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ea0bac89e84365ab08fd7cbad65f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:53Z,use_quota=True,user_id='9ee06111e3e74690b6ca13c766d61e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3054f68-e579-46d9-b8ca-7118dcf19339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3054f68-e579-46d9-b8ca-7118dcf19339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf0f593-f7a7-4dd2-a3c5-7ab125f94330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bf0f593-f7a7-4dd2-a3c5-7ab125f94330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '942931b4-6a53-490e-a239-7aae4e5e7c05', 'volume_name': 'volume-942931b4-6a53-490e-a239-7aae4e5e7c05', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f929b9c-faf3-4d45-b052-3f2f7931f6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f929b9c-faf3-4d45-b052-3f2f7931f6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1673e51c-a79f-4b01-99d4-f8d3781a7c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:52 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Volume 942931b4-6a53-490e-a239-7aae4e5e7c05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-942931b4-6a53-490e-a239-7aae4e5e7c05', 'volume_size': 1} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2123130881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=942931b4-6a53-490e-a239-7aae4e5e7c05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54ea0bac89e84365ab08fd7cbad65f97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:28:53Z,use_quota=True,user_id='9ee06111e3e74690b6ca13c766d61e92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Creating volume 942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:28:52 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-5f8a23e0-79b3-499f-8c47-eff192eb7957" released by "delete_volume" :: held 0.813s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:52 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 1073741824 Sep 28 12:28:52 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created reservations ['f6e3abb4-f1eb-4195-acf2-2831d8443ca9', '786b1352-6e3a-496a-a71d-56c226088c4b', '8ce580c0-1293-4498-832f-158d3ad95a29', '6fec792e-e40f-4afe-9967-9bd03514e177'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:52 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:52 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-quobyte-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e42d58c-b245-4a8c-9978-7b49eec3f5bb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:53 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.291s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Deleted volume successfully. Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-794e36ae-6643-4807-a681-08f0b015db89 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-5f8a23e0-79b3-499f-8c47-eff192eb7957-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:53 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 1073741824" returned: 0 in 0.540s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:53 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 Sep 28 12:28:53 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:53 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 Sep 28 12:28:53 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:53 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904" returned: 0 in 0.415s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:53 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904 Sep 28 12:28:53 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:53 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05" returned: 0 in 0.289s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1673e51c-a79f-4b01-99d4-f8d3781a7c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-942931b4-6a53-490e-a239-7aae4e5e7c05', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ac0e44-c4f9-4cef-a9a0-3df5e8f2ced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:28:53 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Volume volume-942931b4-6a53-490e-a239-7aae4e5e7c05 (942931b4-6a53-490e-a239-7aae4e5e7c05): created successfully Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ac0e44-c4f9-4cef-a9a0-3df5e8f2ced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Flow 'volume_create_manager' (3bd12e2e-a81b-4a2e-9018-6d45f6578cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:28:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-74b1ea4c-0459-4df0-9206-ca95237a6b0f tempest-VolumesActionsTest-1886062030 None] Created volume successfully. Sep 28 12:28:53 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904" returned: 0 in 0.260s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904" released by "delete_volume" :: held 0.721s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created reservations ['5534f9ab-be44-4f80-b6f2-10869494765d', 'adffeafc-282e-4562-b78b-de5cf3225a44', '2fcfca06-6fac-4bd6-b97a-a502e2ab1532', '3a7278aa-ae57-445e-951e-216b39f9f956'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:53 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:53 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:54 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.260s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:54 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Deleted volume successfully. Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-b9d2a721-a7d8-404a-a901-3bf98dbe6080-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53e35a43-4fc7-49f1-9eae-bac2baf83214 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-a4d0e7b4-9b2c-4ff4-88ee-33bb77adb904-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-b9d2a721-a7d8-404a-a901-3bf98dbe6080-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-quobyte-b9d2a721-a7d8-404a-a901-3bf98dbe6080" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-b9d2a721-a7d8-404a-a901-3bf98dbe6080" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f5632c-9d16-4a09-b532-e09f8e904648]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:54 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 Sep 28 12:28:54 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:54 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080" returned: 0 in 0.394s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:54 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080 Sep 28 12:28:54 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:54 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b9d2a721-a7d8-404a-a901-3bf98dbe6080" returned: 0 in 0.271s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-b9d2a721-a7d8-404a-a901-3bf98dbe6080" released by "delete_volume" :: held 0.707s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created reservations ['a910b024-8347-46e5-b9cf-7b3617e7d13d', '606e072f-4bde-4fbc-b9c0-834fea778306', '3975a51d-714e-4428-ac65-0087edd53381', 'aa5df368-26c3-4a5e-b345-3cf4cdf2fc6d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:55 devstack sudo[104248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:55 devstack sudo[104248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:55 devstack sudo[104248]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-8ce943c6-420a-4b47-9994-7ff766a673ba-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.284s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:55 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Deleted volume successfully. Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-8ce943c6-420a-4b47-9994-7ff766a673ba-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2274134-9937-4a35-ba6b-57ef5b1fee99 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-b9d2a721-a7d8-404a-a901-3bf98dbe6080-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-quobyte-8ce943c6-420a-4b47-9994-7ff766a673ba" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-8ce943c6-420a-4b47-9994-7ff766a673ba" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abea393-a45a-49b5-8677-6b4598cc66dd]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:55 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba Sep 28 12:28:55 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:55 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba" returned: 0 in 0.376s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:55 devstack sudo[104259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba Sep 28 12:28:55 devstack sudo[104259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:56 devstack sudo[104259]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-8ce943c6-420a-4b47-9994-7ff766a673ba" returned: 0 in 0.269s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-8ce943c6-420a-4b47-9994-7ff766a673ba" released by "delete_volume" :: held 0.699s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created reservations ['f2add690-ade8-4385-8ead-556f747a4244', '5bca66e5-bd1d-430e-b629-c6dfa1ff876a', 'ddb3573e-7302-4ee6-84b5-ed08aa8c0a27', 'ba1dfbfa-37a6-4feb-b9a5-3bae7c928533'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:56 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:56 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:56 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.273s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:56 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Deleted volume successfully. Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34da7d4f-b15b-4d28-8fce-15a86ebe65ac tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-8ce943c6-420a-4b47-9994-7ff766a673ba-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-quobyte-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1d5895-f1c3-4a1f-ab51-f5189c9d5d29]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:56 devstack sudo[104265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 Sep 28 12:28:56 devstack sudo[104265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:57 devstack sudo[104265]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1" returned: 0 in 0.478s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:57 devstack sudo[104270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1 Sep 28 12:28:57 devstack sudo[104270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:57 devstack sudo[104270]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1" returned: 0 in 0.285s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1" released by "delete_volume" :: held 0.837s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created reservations ['d82a4ed8-0776-4d0f-805f-65d84b96e17a', '7ab4fb1e-aaac-4fb4-9156-7f1fa1600fc2', 'cb74deb4-28c4-464d-87b5-961bb1f8dfff', 'a166e71c-eefd-4938-9ef1-061dc99d35ca'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:57 devstack sudo[104282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:28:57 devstack sudo[104282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-quobyte-b428635b-af22-4c41-9327-b45e5c281c70" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-b428635b-af22-4c41-9327-b45e5c281c70" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-quobyte-d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:28:57 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Deleting offline snapshot d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d of volume b428635b-af22-4c41-9327-b45e5c281c70 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] snapshot_file for this snap is: volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d14310-3892-47cb-ae0e-f931cfe226e6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:58 devstack sudo[104282]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.395s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:28:58 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Deleted volume successfully. Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6123d4a1-3f4e-471e-9432-ffdbc33b27a8 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-cfbbf7a1-6fa4-4c0f-8840-9bf3f3d218e1-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:58 devstack sudo[104286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d Sep 28 12:28:58 devstack sudo[104286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:58 devstack sudo[104286]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d" returned: 0 in 0.497s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b428635b-af22-4c41-9327-b45e5c281c70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefae2f8-198d-45a8-963c-11c3be4163f0]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:28:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:58 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 Sep 28 12:28:58 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:59 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70" returned: 0 in 0.417s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:59 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d Sep 28 12:28:59 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:59 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d" returned: 0 in 0.405s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:28:59 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d Sep 28 12:28:59 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:28:59 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Sep 28 12:28:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70.d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d" returned: 0 in 0.283s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:28:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d" released by "_delete_snapshot" :: held 1.822s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-b428635b-af22-4c41-9327-b45e5c281c70" released by "delete_snapshot" :: held 1.862s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:28:59 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created reservations ['5afd2849-161e-44b5-8745-311ff9ff1e6f', '95cc1647-d2c7-4d0b-8ae1-dfe779762776', '302fd2e9-01ba-496b-8318-ba139d83d3b8', 'a1ca4b4c-78b2-4dfb-8905-4fa6d92dcb8e'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:28:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Delete snapshot completed successfully. Sep 28 12:28:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e7a6e5d5-c460-4434-9fb0-4364911c11e5 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-d7c23e86-d623-4fbf-b8b1-5ba87a8ab00d-delete_snapshot" released by "delete_snapshot" :: held 2.045s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-b428635b-af22-4c41-9327-b45e5c281c70-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-b428635b-af22-4c41-9327-b45e5c281c70-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "cinder-quobyte-b428635b-af22-4c41-9327-b45e5c281c70" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-b428635b-af22-4c41-9327-b45e5c281c70" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64e200b-248e-4b81-b5e3-ca15d9659681]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:00 devstack sudo[104349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 Sep 28 12:29:00 devstack sudo[104349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:01 devstack sudo[104349]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70" returned: 0 in 0.570s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:01 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70 Sep 28 12:29:01 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:01 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b428635b-af22-4c41-9327-b45e5c281c70" returned: 0 in 0.342s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-quobyte-b428635b-af22-4c41-9327-b45e5c281c70" released by "delete_volume" :: held 1.020s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Created reservations ['e1a275fa-919e-43da-8c48-a33771e7cd09', '11911ece-4f8e-48e1-bd14-7ac171387a6f', '16e13581-3b12-43f4-bc18-e1e91f0bb2bf', '3e5f9065-16a5-4889-a7e1-50460fb15215'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:01 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:29:01 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:01 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.262s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:29:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Deleted volume successfully. Sep 28 12:29:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-72082e79-b159-48ba-a27b-87cd4e0ad2a6 tempest-CreateVolumesFromSnapshotTest-1389914323 None] Lock "cinder-b428635b-af22-4c41-9327-b45e5c281c70-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-eb93dab5-0ed6-42af-b76d-8090dd4f7a00 tempest-VolumesActionsTest-1886062030 None] Acquiring lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05" by "attach_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-eb93dab5-0ed6-42af-b76d-8090dd4f7a00 tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05" acquired by "attach_volume" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-eb93dab5-0ed6-42af-b76d-8090dd4f7a00 tempest-VolumesActionsTest-1886062030 None] Attaching volume 942931b4-6a53-490e-a239-7aae4e5e7c05 to instance f16eb101-1015-4330-abcb-f734e05f5ae7 at mountpoint /dev/vdb on host None. Sep 28 12:29:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-eb93dab5-0ed6-42af-b76d-8090dd4f7a00 tempest-VolumesActionsTest-1886062030 None] Attach volume completed successfully. Sep 28 12:29:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-eb93dab5-0ed6-42af-b76d-8090dd4f7a00 tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05" released by "attach_volume" :: held 0.126s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4be2b534-83a6-4621-b205-a4f08ea5d57b tempest-VolumesActionsTest-1886062030 None] Acquiring lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05-detach_volume" by "detach_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4be2b534-83a6-4621-b205-a4f08ea5d57b tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4be2b534-83a6-4621-b205-a4f08ea5d57b tempest-VolumesActionsTest-1886062030 None] Detaching volume 942931b4-6a53-490e-a239-7aae4e5e7c05 from instance f16eb101-1015-4330-abcb-f734e05f5ae7. Sep 28 12:29:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4be2b534-83a6-4621-b205-a4f08ea5d57b tempest-VolumesActionsTest-1886062030 None] Detach volume completed successfully. Sep 28 12:29:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4be2b534-83a6-4621-b205-a4f08ea5d57b tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05-detach_volume" released by "detach_volume" :: held 0.074s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Flow 'volume_create_manager' (a19fd047-dd66-4042-a197-b53d2d2d981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ee2fac-7858-4cc9-8460-32590af22730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07ee2fac-7858-4cc9-8460-32590af22730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1550398636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a788a8b-aff0-4901-89b1-913474663c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04954a703b3e4464ab3df338dc78ffe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:06Z,use_quota=True,user_id='138957bc8fe845a2a5837a6c51d22a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a0af2a-31ef-4be2-adde-52c7bdcb6b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a0af2a-31ef-4be2-adde-52c7bdcb6b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a38766-8562-4b5e-88c2-fe7c2a8fe5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69a38766-8562-4b5e-88c2-fe7c2a8fe5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a788a8b-aff0-4901-89b1-913474663c0f', 'volume_name': 'volume-7a788a8b-aff0-4901-89b1-913474663c0f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c6d183-e79e-4d66-9959-560c6267c160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c6d183-e79e-4d66-9959-560c6267c160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903830e8-75be-4430-a03e-5688cdce1daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:06 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Volume 7a788a8b-aff0-4901-89b1-913474663c0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a788a8b-aff0-4901-89b1-913474663c0f', 'volume_size': 1} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1550398636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a788a8b-aff0-4901-89b1-913474663c0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04954a703b3e4464ab3df338dc78ffe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:06Z,use_quota=True,user_id='138957bc8fe845a2a5837a6c51d22a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Creating volume 7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:29:06 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:06 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f 1073741824 Sep 28 12:29:06 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:06 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f 1073741824" returned: 0 in 0.525s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:06 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f Sep 28 12:29:06 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:07 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f" returned: 0 in 0.256s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:29:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903830e8-75be-4430-a03e-5688cdce1daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a788a8b-aff0-4901-89b1-913474663c0f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2799f3-da5b-43a5-a495-e232dfc78949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:07 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Volume volume-7a788a8b-aff0-4901-89b1-913474663c0f (7a788a8b-aff0-4901-89b1-913474663c0f): created successfully Sep 28 12:29:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2799f3-da5b-43a5-a495-e232dfc78949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:07 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Flow 'volume_create_manager' (a19fd047-dd66-4042-a197-b53d2d2d981a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:07 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-cbb2297d-ab54-42af-9f57-d6e0897d3808 tempest-VolumeDependencyTests-45853076 None] Created volume successfully. Sep 28 12:29:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Creating offline snapshot 31e2e72b-3bcc-4426-9ed3-56ca2a361912 of volume 7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:29:08 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6095779c-c868-4a5b-9ec2-7a3693f7c675]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:08 devstack sudo[104488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f Sep 28 12:29:08 devstack sudo[104488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:08 devstack sudo[104488]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f" returned: 0 in 0.418s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:08 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 1G Sep 28 12:29:09 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:09 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 1G" returned: 0 in 0.524s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a788a8b-aff0-4901-89b1-913474663c0f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:09 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a788a8b-aff0-4901-89b1-913474663c0f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 Sep 28 12:29:09 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:09 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a788a8b-aff0-4901-89b1-913474663c0f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912" returned: 0 in 0.383s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:09 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 is being set with open permissions: ugo+rw Sep 28 12:29:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:09 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 Sep 28 12:29:09 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:10 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912" returned: 0 in 0.432s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:10 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.info Sep 28 12:29:10 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:10 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.info" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:10 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.info is being set with open permissions: ugo+rw Sep 28 12:29:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:10 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.info Sep 28 12:29:10 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:10 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.info" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.482s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:11 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-43d3879c-348c-4761-810d-1616cce9c512 tempest-VolumeDependencyTests-45853076 None] Create snapshot completed successfully Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Flow 'volume_create_manager' (a24fae77-ce9d-4eed-b53a-dcb7f81998ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3b333d-e388-4fe0-8420-df312a86e82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a3b333d-e388-4fe0-8420-df312a86e82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-711511390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04954a703b3e4464ab3df338dc78ffe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=31e2e72b-3bcc-4426-9ed3-56ca2a361912,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:12Z,use_quota=True,user_id='138957bc8fe845a2a5837a6c51d22a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc82896-ca3f-4eb1-a74e-c52153c4bb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc82896-ca3f-4eb1-a74e-c52153c4bb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a528c4d-9381-4437-8e0f-5f2048f147ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a528c4d-9381-4437-8e0f-5f2048f147ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8', 'volume_name': 'volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8', 'volume_size': 1, 'snapshot_id': '31e2e72b-3bcc-4426-9ed3-56ca2a361912'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c93e59d-35d6-445d-af23-7b76b9d23ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c93e59d-35d6-445d-af23-7b76b9d23ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11749ecc-13bb-4ba2-8bb5-b60e97f7df36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:12 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Volume d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8', 'volume_size': 1, 'snapshot_id': '31e2e72b-3bcc-4426-9ed3-56ca2a361912'} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Acquiring lock "cinder-quobyte-31e2e72b-3bcc-4426-9ed3-56ca2a361912-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" by "_create_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-31e2e72b-3bcc-4426-9ed3-56ca2a361912-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Creating volume d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 from snapshot 31e2e72b-3bcc-4426-9ed3-56ca2a361912 {{(pid=87048) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Acquiring lock "cinder-quobyte-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] snapshot: 31e2e72b-3bcc-4426-9ed3-56ca2a361912, volume: d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b1245-6cf2-4044-846d-1ca1f3b3ea4b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:12 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 Sep 28 12:29:12 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:13 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912" returned: 0 in 0.474s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a788a8b-aff0-4901-89b1-913474663c0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:29:13 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fb7b80-f8c5-4ffa-b8ce-1b4b6349e97a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:13 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f Sep 28 12:29:13 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:13 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f" returned: 0 in 0.446s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:29:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:29:13 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:29:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:13 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 Sep 28 12:29:13 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3995e0ae-b87b-4d81-9bbc-b927f45fdacb tempest-VolumesActionsTest-1886062030 None] Acquiring lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05" by "attach_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3995e0ae-b87b-4d81-9bbc-b927f45fdacb tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05" acquired by "attach_volume" :: waited 0.036s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3995e0ae-b87b-4d81-9bbc-b927f45fdacb tempest-VolumesActionsTest-1886062030 None] Attaching volume 942931b4-6a53-490e-a239-7aae4e5e7c05 to instance 4b190cae-7cd9-42c5-8faa-7661c75f66fd at mountpoint /dev/vdb on host None. Sep 28 12:29:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3995e0ae-b87b-4d81-9bbc-b927f45fdacb tempest-VolumesActionsTest-1886062030 None] Attach volume completed successfully. Sep 28 12:29:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3995e0ae-b87b-4d81-9bbc-b927f45fdacb tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05" released by "attach_volume" :: held 0.178s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-32e2054b-a2f6-4be5-a227-e3b0837eea94 tempest-VolumesActionsTest-1886062030 None] Acquiring lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05-detach_volume" by "detach_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-32e2054b-a2f6-4be5-a227-e3b0837eea94 tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-32e2054b-a2f6-4be5-a227-e3b0837eea94 tempest-VolumesActionsTest-1886062030 None] Detaching volume 942931b4-6a53-490e-a239-7aae4e5e7c05 from instance 4b190cae-7cd9-42c5-8faa-7661c75f66fd. Sep 28 12:29:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-32e2054b-a2f6-4be5-a227-e3b0837eea94 tempest-VolumesActionsTest-1886062030 None] Detach volume completed successfully. Sep 28 12:29:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-32e2054b-a2f6-4be5-a227-e3b0837eea94 tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05-detach_volume" released by "detach_volume" :: held 0.161s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:22 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" returned: 0 in 8.699s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f, size 1024.00 MB, duration 8.70 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:29:22 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Converted 1024.00 MB image at 117.70 MB/s Sep 28 12:29:22 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 is being set with open permissions: ugo+rw Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:22 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 Sep 28 12:29:22 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:22 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" returned: 0 in 0.264s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" released by "_copy_volume_from_snapshot" :: held 10.024s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-31e2e72b-3bcc-4426-9ed3-56ca2a361912-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" released by "_create_volume_from_snapshot" :: held 10.101s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.119s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11749ecc-13bb-4ba2-8bb5-b60e97f7df36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8', 'volume_size': 1, 'snapshot_id': '31e2e72b-3bcc-4426-9ed3-56ca2a361912'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bfc5bf-d23e-449e-b90e-9c988f2e5006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:22 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Volume volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 (d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8): created successfully Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3bfc5bf-d23e-449e-b90e-9c988f2e5006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Flow 'volume_create_manager' (a24fae77-ce9d-4eed-b53a-dcb7f81998ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3cb6e181-3fc6-4004-b54b-460648697b3d tempest-VolumeDependencyTests-45853076 None] Created volume successfully. Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Acquiring lock "cinder-31e2e72b-3bcc-4426-9ed3-56ca2a361912-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Lock "cinder-31e2e72b-3bcc-4426-9ed3-56ca2a361912-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Acquiring lock "cinder-quobyte-7a788a8b-aff0-4901-89b1-913474663c0f" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-7a788a8b-aff0-4901-89b1-913474663c0f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Acquiring lock "cinder-quobyte-31e2e72b-3bcc-4426-9ed3-56ca2a361912" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-31e2e72b-3bcc-4426-9ed3-56ca2a361912" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Deleting offline snapshot 31e2e72b-3bcc-4426-9ed3-56ca2a361912 of volume 7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] snapshot_file for this snap is: volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfbd846-362c-445b-ad60-9273001604d6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:23 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 Sep 28 12:29:23 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e5898f-35b9-4f94-ad8a-863601f4ec46]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:23 devstack sudo[104672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 Sep 28 12:29:23 devstack sudo[104672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:24 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912" returned: 0 in 0.417s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a788a8b-aff0-4901-89b1-913474663c0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[15968ffb-95c9-48bf-bb90-e35900969a8c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:24 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f Sep 28 12:29:24 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:24 devstack sudo[104672]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05" returned: 0 in 0.412s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe82a47-31dd-41b5-8a2c-ba3b50da462e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:24 devstack sudo[104682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 Sep 28 12:29:24 devstack sudo[104682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:24 devstack sudo[104682]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05" returned: 0 in 0.397s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.91d0986b-6b12-43b9-8f43-1ca5c4430f14nkoz4292.img {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:24 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f" returned: 0 in 0.588s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:24 devstack sudo[104690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.91d0986b-6b12-43b9-8f43-1ca5c4430f14nkoz4292.img Sep 28 12:29:24 devstack sudo[104690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:24 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 Sep 28 12:29:24 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:25 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912" returned: 0 in 0.487s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:25 devstack sudo[104708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912 Sep 28 12:29:25 devstack sudo[104708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:25 devstack sudo[104708]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f.31e2e72b-3bcc-4426-9ed3-56ca2a361912" returned: 0 in 0.488s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-31e2e72b-3bcc-4426-9ed3-56ca2a361912" released by "_delete_snapshot" :: held 2.164s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-7a788a8b-aff0-4901-89b1-913474663c0f" released by "delete_snapshot" :: held 2.201s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:25 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Created reservations ['58410ee3-1257-4ed2-8694-f6fa91c41f94', '691d10af-832b-4dfd-84cc-82837182c4d5', '4a7163cd-a70e-4c2f-b66f-b682f39e6e78', 'ae2e4ab8-9f01-4d32-9ef2-a0d01cd81270'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:29:26 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Delete snapshot completed successfully. Sep 28 12:29:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11141023-3c54-4b03-abce-0895cac2fafd tempest-VolumeDependencyTests-45853076 None] Lock "cinder-31e2e72b-3bcc-4426-9ed3-56ca2a361912-delete_snapshot" released by "delete_snapshot" :: held 2.519s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Acquiring lock "cinder-7a788a8b-aff0-4901-89b1-913474663c0f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Lock "cinder-7a788a8b-aff0-4901-89b1-913474663c0f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Acquiring lock "cinder-quobyte-7a788a8b-aff0-4901-89b1-913474663c0f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-7a788a8b-aff0-4901-89b1-913474663c0f" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:26 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d9fd5d-fcb5-404c-ad03-527b3dac1228]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:27 devstack sudo[104711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f Sep 28 12:29:27 devstack sudo[104711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:27 devstack sudo[104711]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f" returned: 0 in 0.735s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:27 devstack sudo[104716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f Sep 28 12:29:27 devstack sudo[104716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:28 devstack sudo[104716]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7a788a8b-aff0-4901-89b1-913474663c0f" returned: 0 in 0.405s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-7a788a8b-aff0-4901-89b1-913474663c0f" released by "delete_volume" :: held 1.274s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Created reservations ['83d89d17-c64c-4688-85f9-28f77176a1b7', 'cfa1f220-8b88-4087-9143-6ce87419e398', '9a15bb20-86a3-4fe5-b4ce-f555a43ab35f', 'fa1f3423-f05f-472f-8dc8-cfdf295d675f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:28 devstack sudo[104719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:29:28 devstack sudo[104719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:28 devstack sudo[104719]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:29:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Deleted volume successfully. Sep 28 12:29:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f61af298-6d5f-4912-a737-b15bcc04573e tempest-VolumeDependencyTests-45853076 None] Lock "cinder-7a788a8b-aff0-4901-89b1-913474663c0f-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Acquiring lock "cinder-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Lock "cinder-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Acquiring lock "cinder-quobyte-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:29:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:29:29 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee5eec4-3c20-4468-b7ae-3a809133f2e3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:29 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 Sep 28 12:29:29 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:30 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" returned: 0 in 0.694s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:30 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8 Sep 28 12:29:30 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:30 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" returned: 0 in 0.515s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Lock "cinder-quobyte-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8" released by "delete_volume" :: held 1.295s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Created reservations ['89eb37b3-5dda-4534-8f7a-976cad6cfbe0', '35e214aa-e0a7-4514-8702-428304e6fab1', 'a85a341c-92b6-482c-9cea-18353c61995c', '155b1b0d-46d2-473d-ac14-552a62d5d358'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:30 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:29:30 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:31 devstack sudo[104690]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.91d0986b-6b12-43b9-8f43-1ca5c4430f14nkoz4292.img" returned: 0 in 6.549s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71b106f-90f1-4690-9507-374204635aab]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:31 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.327s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:31 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:29:31 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Deleted volume successfully. Sep 28 12:29:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-01f84e4b-2e86-4bc8-af58-41b47d7afc7a tempest-VolumeDependencyTests-45853076 None] Lock "cinder-d5d4fd1d-e0d1-4f7c-bfdc-71b69810cfd8-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:29:31 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 Sep 28 12:29:31 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:31 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05" returned: 0 in 0.544s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:31 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.91d0986b-6b12-43b9-8f43-1ca5c4430f14nkoz4292.img {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:29:31 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Converted 1024.00 MB image at 156.34 MB/s Sep 28 12:29:31 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] 91d0986b-6b12-43b9-8f43-1ca5c4430f14 was raw, no need to convert to raw {{(pid=87048) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Flow 'volume_create_manager' (b7121f7e-df18-47c3-aaee-828f36fe0e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d11cf5f-04ea-420b-9a5d-677ed409645e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d11cf5f-04ea-420b-9a5d-677ed409645e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458b6554-8dfb-4b7c-b424-e205ee057bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1214dcc1faf4199842484c7bc7b0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:35Z,use_quota=True,user_id='80b7e061677645338af775e5a820f6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53132c1-4a9c-4581-a9a4-7d1d19c533b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53132c1-4a9c-4581-a9a4-7d1d19c533b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb82b803-5c13-41fb-bf36-f35f2713abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb82b803-5c13-41fb-bf36-f35f2713abe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458b6554-8dfb-4b7c-b424-e205ee057bc2', 'volume_name': 'volume-458b6554-8dfb-4b7c-b424-e205ee057bc2', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114b7d31-f24d-43f7-b9d1-bbd348309458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114b7d31-f24d-43f7-b9d1-bbd348309458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e71c2b-b42d-4ae0-b75a-1d2a668dc83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:34 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Volume 458b6554-8dfb-4b7c-b424-e205ee057bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458b6554-8dfb-4b7c-b424-e205ee057bc2', 'volume_size': 1} Sep 28 12:29:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:38 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:29:38 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:38 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.287s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:29:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:29:44 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=71,cinder:INSERT=29,cinder:UPDATE=92,cinder:DELETE=7 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:29:44 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=97,cinder:DELETE=6,cinder:SELECT=86,cinder:INSERT=20 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.497s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Uploaded volume to glance image-id: 91d0986b-6b12-43b9-8f43-1ca5c4430f14. {{(pid=87048) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.344s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458b6554-8dfb-4b7c-b424-e205ee057bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1214dcc1faf4199842484c7bc7b0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:35Z,use_quota=True,user_id='80b7e061677645338af775e5a820f6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Creating volume 458b6554-8dfb-4b7c-b424-e205ee057bc2 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:29:50 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:50 devstack sudo[104746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 1073741824 Sep 28 12:29:50 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:50 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ea816533-fe6e-47c9-aa39-6b371fde3be4 tempest-VolumesActionsTest-1886062030 None] Copy volume to image completed successfully. Sep 28 12:29:50 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 1073741824" returned: 0 in 0.430s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:50 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 Sep 28 12:29:50 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:51 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2" returned: 0 in 0.269s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05e71c2b-b42d-4ae0-b75a-1d2a668dc83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458b6554-8dfb-4b7c-b424-e205ee057bc2', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8931a15e-4297-4d5f-90ad-0716007f59b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:51 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Volume volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 (458b6554-8dfb-4b7c-b424-e205ee057bc2): created successfully Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8931a15e-4297-4d5f-90ad-0716007f59b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Flow 'volume_create_manager' (b7121f7e-df18-47c3-aaee-828f36fe0e67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6812ba61-72df-42fb-83fd-8e4ddbbd55e9 tempest-CinderUnicodeTest-289184471 None] Created volume successfully. Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[652d22e9-7ce5-455e-b429-1b10332c3b15]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:51 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 Sep 28 12:29:51 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:52 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05" returned: 0 in 0.386s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ef3b37-a70a-4bf8-9c76-4bdfb17a6438]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:52 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 Sep 28 12:29:52 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:29:52 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Flow 'volume_create_manager' (4f43e0d5-a3eb-4c74-832c-699c9b6e030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e1a01d-73e9-441d-9d61-a8eedd753d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05" returned: 0 in 0.424s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4e1a01d-73e9-441d-9d61-a8eedd753d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1959932637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1214dcc1faf4199842484c7bc7b0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:52Z,use_quota=True,user_id='80b7e061677645338af775e5a820f6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:52 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img Sep 28 12:29:52 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ab316c-67cb-436f-bcf4-9cc16a8162ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96ab316c-67cb-436f-bcf4-9cc16a8162ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2379f983-48a1-492b-adad-4b80bf08d0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2379f983-48a1-492b-adad-4b80bf08d0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa', 'volume_name': 'volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7c9b9e-d25d-4ff9-9263-4c74e4f8f8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7c9b9e-d25d-4ff9-9263-4c74e4f8f8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b1eee0-74b4-4c01-9b84-e2e49f83e79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:29:52 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Volume 9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa', 'volume_size': 1} Sep 28 12:29:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:29:58 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img" returned: 0 in 5.831s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07710c1-e8a7-48f8-91f1-885a76bd1f07]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:58 devstack sudo[104780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 Sep 28 12:29:58 devstack sudo[104780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:58 devstack sudo[104780]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05" returned: 0 in 0.536s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:58 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:29:58 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Converted 1024.00 MB image at 175.59 MB/s Sep 28 12:29:58 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] 5d43ad9c-ffbe-491d-a069-eebc52b4e091 was raw, converting to qcow2 {{(pid=87048) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 12:29:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34efb47-fec7-4f31-90da-d23b61578369]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:59 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img Sep 28 12:29:59 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:59 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img" returned: 0 in 0.324s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:59 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img Sep 28 12:29:59 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:59 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img" returned: 1 in 0.330s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:29:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img /opt/stack/data/cinder/conversion/vol_upload_a1do1g7n {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:59 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img /opt/stack/data/cinder/conversion/vol_upload_a1do1g7n Sep 28 12:29:59 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:29:59 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 28 12:29:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img /opt/stack/data/cinder/conversion/vol_upload_a1do1g7n" returned: 0 in 0.251s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:29:59 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Image conversion details: src /opt/stack/data/cinder/conversion/942931b4-6a53-490e-a239-7aae4e5e7c05.temp_image.5d43ad9c-ffbe-491d-a069-eebc52b4e091fi2_iw_v.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_a1do1g7n {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:29:59 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 12:29:59 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f57bdd-2d7a-415d-bc38-23f5323b8cff]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:29:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a1do1g7n {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:29:59 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a1do1g7n Sep 28 12:29:59 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:00 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_a1do1g7n" returned: 0 in 0.344s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.744s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Uploaded volume to glance image-id: 5d43ad9c-ffbe-491d-a069-eebc52b4e091. {{(pid=87048) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.843s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:29:52Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1959932637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1214dcc1faf4199842484c7bc7b0184',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:29:52Z,use_quota=True,user_id='80b7e061677645338af775e5a820f6d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Creating volume 9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:30:01 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:01 devstack sudo[104805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa 1073741824 Sep 28 12:30:01 devstack sudo[104805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8b05aca5-90a0-4d8b-b3bf-4f7e1a78f7a2 tempest-VolumesActionsTest-1886062030 None] Copy volume to image completed successfully. Sep 28 12:30:01 devstack sudo[104805]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa 1073741824" returned: 0 in 0.430s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:01 devstack sudo[104810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa Sep 28 12:30:01 devstack sudo[104810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:02 devstack sudo[104810]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" returned: 0 in 0.248s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60b1eee0-74b4-4c01-9b84-e2e49f83e79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ff889c-64ca-47bd-a2d8-518ecd85b01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:02 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Volume volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa (9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa): created successfully Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89ff889c-64ca-47bd-a2d8-518ecd85b01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Flow 'volume_create_manager' (4f43e0d5-a3eb-4c74-832c-699c9b6e030b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:02 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4480b8a2-5db8-4fe7-9506-74a60b696dcc tempest-CinderUnicodeTest-289184471 None] Created volume successfully. Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Acquiring lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Acquiring lock "cinder-quobyte-942931b4-6a53-490e-a239-7aae4e5e7c05" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Lock "cinder-quobyte-942931b4-6a53-490e-a239-7aae4e5e7c05" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4a2abb-9f5f-4104-9b62-114e3a4142a5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:02 devstack sudo[104819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 Sep 28 12:30:02 devstack sudo[104819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:03 devstack sudo[104819]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05" returned: 0 in 0.387s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:03 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05 Sep 28 12:30:03 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Creating offline snapshot 12468c73-d297-4875-b358-d5e224292f13 of volume 9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dc8171-1e01-4a1c-bc3a-be222cf5e132]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:03 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-942931b4-6a53-490e-a239-7aae4e5e7c05" returned: 0 in 0.301s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Lock "cinder-quobyte-942931b4-6a53-490e-a239-7aae4e5e7c05" released by "delete_volume" :: held 0.737s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Created reservations ['f78ae10a-9d18-4ed0-8da7-4b114bbae52f', '7f8be779-44a6-425f-ab58-c41f25ce5a43', '0df27be8-f70e-4805-9ec9-37d21fa5e939', '06cccb22-7c60-4b7b-8cf8-5686c13f25d4'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:03 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa Sep 28 12:30:03 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:03 devstack sudo[104867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:03 devstack sudo[104867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:03 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" returned: 0 in 0.408s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:03 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 1G Sep 28 12:30:03 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:03 devstack sudo[104867]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.277s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:03 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:03 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Deleted volume successfully. Sep 28 12:30:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34cebd34-dbed-4b20-8f5e-89f39beb3f3a tempest-VolumesActionsTest-1886062030 None] Lock "cinder-942931b4-6a53-490e-a239-7aae4e5e7c05-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:04 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 1G" returned: 0 in 0.424s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:04 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 Sep 28 12:30:04 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:04 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13" returned: 0 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:04 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 is being set with open permissions: ugo+rw Sep 28 12:30:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:04 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 Sep 28 12:30:04 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:04 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13" returned: 0 in 0.257s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:05 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.info Sep 28 12:30:05 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:05 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.info" returned: 0 in 0.290s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:05 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.info is being set with open permissions: ugo+rw Sep 28 12:30:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:05 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.info Sep 28 12:30:05 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:05 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.info" returned: 0 in 0.270s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:05 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-afac7af6-ab8b-45de-a551-d249c96a864c tempest-CinderUnicodeTest-289184471 None] Create snapshot completed successfully Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "cinder-12468c73-d297-4875-b358-d5e224292f13-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-12468c73-d297-4875-b358-d5e224292f13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "cinder-quobyte-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-quobyte-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "cinder-quobyte-12468c73-d297-4875-b358-d5e224292f13" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-quobyte-12468c73-d297-4875-b358-d5e224292f13" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Deleting offline snapshot 12468c73-d297-4875-b358-d5e224292f13 of volume 9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] snapshot_file for this snap is: volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e582232d-b37e-41d9-aa8d-303b64c2dac3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:06 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 Sep 28 12:30:06 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:07 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13" returned: 0 in 0.395s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:07 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:30:07 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[54585c49-4356-4817-ad4e-c6c1cf459790]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:07 devstack sudo[104900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa Sep 28 12:30:07 devstack sudo[104900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:07 devstack sudo[104900]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" returned: 0 in 0.449s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:07 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 Sep 28 12:30:07 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:07 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13" returned: 0 in 0.401s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:08 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13 Sep 28 12:30:08 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:08 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa.12468c73-d297-4875-b358-d5e224292f13" returned: 0 in 0.332s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-quobyte-12468c73-d297-4875-b358-d5e224292f13" released by "_delete_snapshot" :: held 1.700s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-quobyte-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" released by "delete_snapshot" :: held 1.724s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Created reservations ['13c9d79a-0a9b-4ef8-96d2-719dea0a292b', '4d2ff59a-1d6a-4dfc-bbef-de6a36e63d0e', '5244688d-4df1-4a99-adbc-64d3a2daab65', 'a1b75d69-2973-4909-a75d-d8f715830277'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:08 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Delete snapshot completed successfully. Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-bbe899f1-c67d-4b06-8a87-a6c006bb4e60 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-12468c73-d297-4875-b358-d5e224292f13-delete_snapshot" released by "delete_snapshot" :: held 1.881s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "cinder-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "cinder-quobyte-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-quobyte-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec325f2-38c2-4be3-b213-acd0793d78a7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:09 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa Sep 28 12:30:09 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:09 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" returned: 0 in 0.401s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:09 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa Sep 28 12:30:09 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:09 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" returned: 0 in 0.256s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-quobyte-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa" released by "delete_volume" :: held 0.740s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Created reservations ['47ee4105-af77-4087-9c84-dc69249aa54a', '2676a7a2-76c2-427c-829a-fcb6e9c5df8d', '948bf121-6da7-4c2b-83b6-1dba9ed2a184', '9d73f444-f3e8-4276-9893-cfe5452e1ab2'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:09 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:09 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "cinder-458b6554-8dfb-4b7c-b424-e205ee057bc2-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-458b6554-8dfb-4b7c-b424-e205ee057bc2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "cinder-quobyte-458b6554-8dfb-4b7c-b424-e205ee057bc2" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:10 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-quobyte-458b6554-8dfb-4b7c-b424-e205ee057bc2" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.352s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:10 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Deleted volume successfully. Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae66bc-52a2-4bc8-8558-06d90ab4f5cc]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a3b80364-4a6a-4fc6-8c9d-0c58f2d7cce3 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-9a6eef6d-5b0b-434a-b52a-cf835b6cb4aa-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:10 devstack sudo[104926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 Sep 28 12:30:10 devstack sudo[104926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:10 devstack sudo[104926]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2" returned: 0 in 0.457s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:10 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2 Sep 28 12:30:10 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:10 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-458b6554-8dfb-4b7c-b424-e205ee057bc2" returned: 0 in 0.272s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-quobyte-458b6554-8dfb-4b7c-b424-e205ee057bc2" released by "delete_volume" :: held 0.785s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Created reservations ['8f205804-5aa4-45a2-8e96-17f52a9fa02b', '17ede84c-d92b-46a9-a1d0-7f2d619c3be3', 'd83a7aaf-5e0c-49c1-8dec-9dbac4ac4799', '38e4c7c0-6201-491d-8a3a-8f6fc97ab641'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:11 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:11 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:11 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.266s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:11 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Deleted volume successfully. Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-812cc812-ebdb-4553-b357-1959cffe3699 tempest-CinderUnicodeTest-289184471 None] Lock "cinder-458b6554-8dfb-4b7c-b424-e205ee057bc2-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Flow 'volume_create_manager' (47e60eb9-4940-4053-9e0b-a15ba13e7958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550c9899-ce1d-4ab0-baff-276668f76403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550c9899-ce1d-4ab0-baff-276668f76403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-341822676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9e32ef-15e0-4c98-bcaf-11aa35595a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c49301321f4ab49ea6d2ce67f985ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:12Z,use_quota=True,user_id='1026ca19fac241f481aeae2319d32c90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbfc95c-f17e-405a-96df-ef0bff0bf85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cbfc95c-f17e-405a-96df-ef0bff0bf85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d5ad36-4222-4a41-894a-4ef6d5734105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89d5ad36-4222-4a41-894a-4ef6d5734105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b9e32ef-15e0-4c98-bcaf-11aa35595a3d', 'volume_name': 'volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d', 'volume_size': 2}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066cdf83-f31a-47ab-819f-b578e64cd722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066cdf83-f31a-47ab-819f-b578e64cd722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c68ec5b-ee00-486c-8c06-c540fa1f0044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:11 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Volume 0b9e32ef-15e0-4c98-bcaf-11aa35595a3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d', 'volume_size': 2} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-341822676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b9e32ef-15e0-4c98-bcaf-11aa35595a3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31c49301321f4ab49ea6d2ce67f985ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:12Z,use_quota=True,user_id='1026ca19fac241f481aeae2319d32c90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Creating volume 0b9e32ef-15e0-4c98-bcaf-11aa35595a3d {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:30:11 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:30:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d 2147483648 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:11 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d 2147483648 Sep 28 12:30:11 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:12 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d 2147483648" returned: 0 in 0.527s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:12 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d Sep 28 12:30:12 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:12 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:30:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c68ec5b-ee00-486c-8c06-c540fa1f0044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d', 'volume_size': 2}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cd4081-6a87-4b65-b87c-e9fde2f4518a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:12 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Volume volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d (0b9e32ef-15e0-4c98-bcaf-11aa35595a3d): created successfully Sep 28 12:30:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09cd4081-6a87-4b65-b87c-e9fde2f4518a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Flow 'volume_create_manager' (47e60eb9-4940-4053-9e0b-a15ba13e7958) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6ae57648-d221-4f99-8973-979810fb73f8 tempest-VolumesCloneNegativeTest-655213200 None] Created volume successfully. Sep 28 12:30:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Acquiring lock "cinder-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Lock "cinder-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Acquiring lock "cinder-quobyte-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Lock "cinder-quobyte-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:13 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bb32dd-f84a-40bc-a3e9-46624b0bba0a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:14 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d Sep 28 12:30:14 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:14 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d" returned: 0 in 0.410s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:14 devstack sudo[104954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d Sep 28 12:30:14 devstack sudo[104954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:14 devstack sudo[104954]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d" returned: 0 in 0.262s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Lock "cinder-quobyte-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d" released by "delete_volume" :: held 0.721s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Created reservations ['8ba9a1c3-d7cc-49b7-86b2-28d679b4b0dc', 'f7e76938-5bdb-410e-8d1c-7bf5474ca59b', '54100819-c6e5-49ac-a941-fc1eeb320d8f', '03ae3d3b-5987-4895-b8d3-0cadc502ce61'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:14 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:14 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:15 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.275s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:15 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Deleted volume successfully. Sep 28 12:30:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-38170096-ffe7-45aa-9bab-ad2e7f524b3d tempest-VolumesCloneNegativeTest-655213200 None] Lock "cinder-0b9e32ef-15e0-4c98-bcaf-11aa35595a3d-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Flow 'volume_create_manager' (b974bbbe-103f-40d8-80e2-912e6e983f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daf61a2-390e-496c-a599-ceb9e4550005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7daf61a2-390e-496c-a599-ceb9e4550005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1971367166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e67222-efb8-4177-85ae-2c0d04d195cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='720f18d383e54d2dba5b0c80a803ac6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:24Z,use_quota=True,user_id='59ffa758ee7c445aa3631dff1533e6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67220483-dde6-4bb4-8fc9-e4681ad46e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67220483-dde6-4bb4-8fc9-e4681ad46e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50714770-494b-4153-96b2-9236652d4c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50714770-494b-4153-96b2-9236652d4c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e67222-efb8-4177-85ae-2c0d04d195cd', 'volume_name': 'volume-f0e67222-efb8-4177-85ae-2c0d04d195cd', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e847a8-1bf7-43cf-b682-9b177bbe24a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e847a8-1bf7-43cf-b682-9b177bbe24a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f0343b-4ca9-400d-9c21-b9772bc3177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:23 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Volume f0e67222-efb8-4177-85ae-2c0d04d195cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e67222-efb8-4177-85ae-2c0d04d195cd', 'volume_size': 1} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1971367166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e67222-efb8-4177-85ae-2c0d04d195cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='720f18d383e54d2dba5b0c80a803ac6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:24Z,use_quota=True,user_id='59ffa758ee7c445aa3631dff1533e6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Creating volume f0e67222-efb8-4177-85ae-2c0d04d195cd {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:30:23 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:30:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:23 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd 1073741824 Sep 28 12:30:23 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:24 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd 1073741824" returned: 0 in 0.466s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:24 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd Sep 28 12:30:24 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:24 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd" returned: 0 in 0.250s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:30:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00f0343b-4ca9-400d-9c21-b9772bc3177e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e67222-efb8-4177-85ae-2c0d04d195cd', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1871aae4-e4da-4c28-acb6-4f85c05a3207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:24 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Volume volume-f0e67222-efb8-4177-85ae-2c0d04d195cd (f0e67222-efb8-4177-85ae-2c0d04d195cd): created successfully Sep 28 12:30:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1871aae4-e4da-4c28-acb6-4f85c05a3207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Flow 'volume_create_manager' (b974bbbe-103f-40d8-80e2-912e6e983f36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:24 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c71c53d1-7fcc-4358-a9aa-38851f2e9543 tempest-VolumesListTestJSON-1955759168 None] Created volume successfully. Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Flow 'volume_create_manager' (93c5f4ef-edee-4c62-98e0-28255d11b0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3bcabb-4022-4a79-b8b3-f5d2bdc801ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3bcabb-4022-4a79-b8b3-f5d2bdc801ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170241603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde948f8-20dc-4870-989a-b5d4f1823fbe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='720f18d383e54d2dba5b0c80a803ac6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:25Z,use_quota=True,user_id='59ffa758ee7c445aa3631dff1533e6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7012f0e-9008-4a7d-aed8-29fbdd643a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7012f0e-9008-4a7d-aed8-29fbdd643a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b747f7d0-f3c5-4eea-90e4-ae3f1258e9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b747f7d0-f3c5-4eea-90e4-ae3f1258e9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde948f8-20dc-4870-989a-b5d4f1823fbe', 'volume_name': 'volume-dde948f8-20dc-4870-989a-b5d4f1823fbe', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681971b0-e506-429e-af4b-6311294d88a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (681971b0-e506-429e-af4b-6311294d88a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58dcaa1-8114-4647-9a5d-42df1dd25196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:25 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Volume dde948f8-20dc-4870-989a-b5d4f1823fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde948f8-20dc-4870-989a-b5d4f1823fbe', 'volume_size': 1} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-170241603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde948f8-20dc-4870-989a-b5d4f1823fbe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='720f18d383e54d2dba5b0c80a803ac6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:25Z,use_quota=True,user_id='59ffa758ee7c445aa3631dff1533e6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Creating volume dde948f8-20dc-4870-989a-b5d4f1823fbe {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:30:25 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:25 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe 1073741824 Sep 28 12:30:25 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:25 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe 1073741824" returned: 0 in 0.454s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:25 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe Sep 28 12:30:25 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:26 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe" returned: 0 in 0.253s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:30:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58dcaa1-8114-4647-9a5d-42df1dd25196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde948f8-20dc-4870-989a-b5d4f1823fbe', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc92fa4-9141-42b8-82bc-b0425dcbb3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:26 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Volume volume-dde948f8-20dc-4870-989a-b5d4f1823fbe (dde948f8-20dc-4870-989a-b5d4f1823fbe): created successfully Sep 28 12:30:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebc92fa4-9141-42b8-82bc-b0425dcbb3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Flow 'volume_create_manager' (93c5f4ef-edee-4c62-98e0-28255d11b0c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:26 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5359b7af-3063-44d3-9da0-6f90934456ec tempest-VolumesListTestJSON-1955759168 None] Created volume successfully. Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Flow 'volume_create_manager' (d66de0c0-3a3f-4585-a734-6cb2afa05233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c5722a-b7c7-4f6d-8fad-7db88eb2d84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c5722a-b7c7-4f6d-8fad-7db88eb2d84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-55061052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f5d2b0-2cf7-451c-9139-729ca98df2f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='720f18d383e54d2dba5b0c80a803ac6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:28Z,use_quota=True,user_id='59ffa758ee7c445aa3631dff1533e6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e856b18-8822-4e3e-b94d-ddff9e75a0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e856b18-8822-4e3e-b94d-ddff9e75a0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a03567-3fc5-48a5-a575-5526c599a197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25a03567-3fc5-48a5-a575-5526c599a197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57f5d2b0-2cf7-451c-9139-729ca98df2f8', 'volume_name': 'volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abad037-a693-46ce-805b-01dfb1af763d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3abad037-a693-46ce-805b-01dfb1af763d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf63e94e-78b9-4f93-b79c-c09041056e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:27 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Volume 57f5d2b0-2cf7-451c-9139-729ca98df2f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8', 'volume_size': 1} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-55061052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f5d2b0-2cf7-451c-9139-729ca98df2f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='720f18d383e54d2dba5b0c80a803ac6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:28Z,use_quota=True,user_id='59ffa758ee7c445aa3631dff1533e6fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Creating volume 57f5d2b0-2cf7-451c-9139-729ca98df2f8 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:30:27 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:30:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:27 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 1073741824 Sep 28 12:30:27 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:28 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 1073741824" returned: 0 in 0.562s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:28 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 Sep 28 12:30:28 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:28 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8" returned: 0 in 0.253s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:30:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf63e94e-78b9-4f93-b79c-c09041056e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af95d127-0103-4e93-8e08-933405188304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:28 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Volume volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 (57f5d2b0-2cf7-451c-9139-729ca98df2f8): created successfully Sep 28 12:30:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af95d127-0103-4e93-8e08-933405188304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Flow 'volume_create_manager' (d66de0c0-3a3f-4585-a734-6cb2afa05233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7dcc33f8-90a3-461e-960e-a02e9bef3ad5 tempest-VolumesListTestJSON-1955759168 None] Created volume successfully. Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "cinder-57f5d2b0-2cf7-451c-9139-729ca98df2f8-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-57f5d2b0-2cf7-451c-9139-729ca98df2f8-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "cinder-quobyte-57f5d2b0-2cf7-451c-9139-729ca98df2f8" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-quobyte-57f5d2b0-2cf7-451c-9139-729ca98df2f8" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4798039e-1825-4e96-ae11-9a81199737e7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:32 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 Sep 28 12:30:32 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:32 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8" returned: 0 in 0.400s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:32 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8 Sep 28 12:30:32 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:32 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-57f5d2b0-2cf7-451c-9139-729ca98df2f8" returned: 0 in 0.270s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-quobyte-57f5d2b0-2cf7-451c-9139-729ca98df2f8" released by "delete_volume" :: held 0.721s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Created reservations ['bcbfaad0-91e2-4c1e-8286-33b02b2d47af', 'e2f08a3b-66d2-494e-b5a2-8bdfdec682dc', '508cc17e-2c39-4fc6-908e-36a771d9ecc9', '912a316d-ab75-409d-8063-e7ea58cc2732'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:33 devstack sudo[104998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:33 devstack sudo[104998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "cinder-dde948f8-20dc-4870-989a-b5d4f1823fbe-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:33 devstack sudo[104998]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.374s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Deleted volume successfully. Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-dde948f8-20dc-4870-989a-b5d4f1823fbe-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9c8c7bac-ea4e-4222-9d61-a7e090fd138a tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-57f5d2b0-2cf7-451c-9139-729ca98df2f8-delete_volume" released by "delete_volume" :: held 1.353s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "cinder-quobyte-dde948f8-20dc-4870-989a-b5d4f1823fbe" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-quobyte-dde948f8-20dc-4870-989a-b5d4f1823fbe" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59a5a47-4383-404f-b993-3745b923d64d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:33 devstack sudo[105001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe Sep 28 12:30:33 devstack sudo[105001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:33 devstack sudo[105001]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe" returned: 0 in 0.388s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:33 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe Sep 28 12:30:33 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:34 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-dde948f8-20dc-4870-989a-b5d4f1823fbe" returned: 0 in 0.255s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-quobyte-dde948f8-20dc-4870-989a-b5d4f1823fbe" released by "delete_volume" :: held 0.689s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Flow 'volume_create_manager' (9fa2ce8d-73c0-4c7f-9e66-8a287d2146d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2810d03-cda0-4ac0-b1c9-55cc2e0be2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2810d03-cda0-4ac0-b1c9-55cc2e0be2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1898400952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7972124f61ec40ecb0c241cf707b09d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:34Z,use_quota=True,user_id='282534f81cbf48f199ef4b8b3cf7c429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7036a767-0d0a-48da-a8f2-731859cca6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7036a767-0d0a-48da-a8f2-731859cca6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc51ed4-5288-482f-b9e8-502ff5bb78ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fc51ed4-5288-482f-b9e8-502ff5bb78ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0', 'volume_name': 'volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195caa13-b4c0-4d2e-a873-6ce7ad376f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (195caa13-b4c0-4d2e-a873-6ce7ad376f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f8c266-693d-4cf9-ba34-67f27121f2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:34 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Volume 6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0', 'volume_size': 1} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1898400952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7972124f61ec40ecb0c241cf707b09d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:34Z,use_quota=True,user_id='282534f81cbf48f199ef4b8b3cf7c429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Creating volume 6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:30:34 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:34 devstack sudo[105010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 1073741824 Sep 28 12:30:34 devstack sudo[105010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Created reservations ['6c0206bf-c65c-460a-ae85-67cb06dbc9a7', 'efbacc06-16bb-4578-af2a-02253849ea6f', '7031d442-10ec-46ad-81fa-dd6d7bc6df95', 'd88fda69-dc35-40be-a2ea-9d3b2959cd94'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:34 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:34 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "cinder-f0e67222-efb8-4177-85ae-2c0d04d195cd-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-f0e67222-efb8-4177-85ae-2c0d04d195cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:34 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.304s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Deleted volume successfully. Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bcbbdfe-ce5f-4795-9aa8-f0037178d765 tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-dde948f8-20dc-4870-989a-b5d4f1823fbe-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "cinder-quobyte-f0e67222-efb8-4177-85ae-2c0d04d195cd" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-quobyte-f0e67222-efb8-4177-85ae-2c0d04d195cd" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[0581d155-6d74-4d42-ba8f-12528451edd5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:34 devstack sudo[105010]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 1073741824" returned: 0 in 0.535s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:34 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 Sep 28 12:30:34 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:34 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd Sep 28 12:30:34 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:35 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" returned: 0 in 0.274s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f8c266-693d-4cf9-ba34-67f27121f2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb2c9cb-3721-453f-b1f5-68d16329a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:35 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Volume volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 (6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0): created successfully Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb2c9cb-3721-453f-b1f5-68d16329a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Flow 'volume_create_manager' (9fa2ce8d-73c0-4c7f-9e66-8a287d2146d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:35 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd" returned: 0 in 0.394s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f3599465-7d5e-4488-82f4-227c591794bf tempest-SnapshotDependencyTests-1787849270 None] Created volume successfully. Sep 28 12:30:35 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd Sep 28 12:30:35 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:35 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f0e67222-efb8-4177-85ae-2c0d04d195cd" returned: 0 in 0.277s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-quobyte-f0e67222-efb8-4177-85ae-2c0d04d195cd" released by "delete_volume" :: held 0.713s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Created reservations ['1c13ff59-458d-4118-820a-3341eb2c8950', '1d18bf91-89d4-400b-884e-85cabf4cabaf', '114441ea-4083-4b43-ae4c-dc6e455e5c6d', '7a7f472b-e1e9-4f67-a0c3-8c974d60f1fb'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:35 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:35 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:35 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.246s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Deleted volume successfully. Sep 28 12:30:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-406dd263-b70d-4906-b13a-3ff7122328bb tempest-VolumesListTestJSON-1955759168 None] Lock "cinder-f0e67222-efb8-4177-85ae-2c0d04d195cd-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Creating offline snapshot 21283955-6bd3-451c-a349-5609095a3674 of volume 6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:30:36 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d8948c-154e-463d-a657-5caa0800cae6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:36 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 Sep 28 12:30:36 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:36 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" returned: 0 in 0.410s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:36 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 1G Sep 28 12:30:36 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:37 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 1G" returned: 0 in 0.472s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:37 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 Sep 28 12:30:37 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:37 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674" returned: 0 in 0.320s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:37 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 is being set with open permissions: ugo+rw Sep 28 12:30:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:37 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 Sep 28 12:30:37 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:37 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674" returned: 0 in 0.261s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:38 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.info Sep 28 12:30:38 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:38 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:38 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:38 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.info" returned: 0 in 0.268s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:38 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.info is being set with open permissions: ugo+rw Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:38 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.info Sep 28 12:30:38 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:38 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.279s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:30:38 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.info" returned: 0 in 0.320s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9f44be04-6695-421d-bd1f-7d5d47efb490 tempest-SnapshotDependencyTests-1787849270 None] Create snapshot completed successfully Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Flow 'volume_create_manager' (20dbb96c-381a-4248-9dee-955a8bb8dbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0057bb9a-53c0-43a3-9976-1cedc0584d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0057bb9a-53c0-43a3-9976-1cedc0584d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7972124f61ec40ecb0c241cf707b09d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=21283955-6bd3-451c-a349-5609095a3674,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:40Z,use_quota=True,user_id='282534f81cbf48f199ef4b8b3cf7c429',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe7da6a-34b5-4522-a863-7a5ba6f32d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbe7da6a-34b5-4522-a863-7a5ba6f32d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3289154a-9901-4c68-bff8-09b28c1f495a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3289154a-9901-4c68-bff8-09b28c1f495a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1', 'volume_name': 'volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1', 'volume_size': 1, 'snapshot_id': '21283955-6bd3-451c-a349-5609095a3674'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f4c9f9-fbfb-4d55-9f30-47414297820a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f4c9f9-fbfb-4d55-9f30-47414297820a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b2b07d-b665-49dd-88c1-518976ff103a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:40 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Volume e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1', 'volume_size': 1, 'snapshot_id': '21283955-6bd3-451c-a349-5609095a3674'} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "cinder-quobyte-21283955-6bd3-451c-a349-5609095a3674-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" by "_create_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-21283955-6bd3-451c-a349-5609095a3674-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Creating volume e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 from snapshot 21283955-6bd3-451c-a349-5609095a3674 {{(pid=87048) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "cinder-quobyte-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] snapshot: 21283955-6bd3-451c-a349-5609095a3674, volume: e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d9bc2c-3082-4685-b75c-082b91ab2e2b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:40 devstack sudo[105063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 Sep 28 12:30:40 devstack sudo[105063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:40 devstack sudo[105063]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674" returned: 0 in 0.419s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5431425b-0507-49c9-8b82-91ddc6b34317]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:40 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 Sep 28 12:30:40 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:41 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" returned: 0 in 0.389s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:30:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:30:41 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:30:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:41 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 Sep 28 12:30:41 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:48 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" returned: 0 in 7.437s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:48 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0, size 1024.00 MB, duration 7.44 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:30:48 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Converted 1024.00 MB image at 137.66 MB/s Sep 28 12:30:48 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 is being set with open permissions: ugo+rw Sep 28 12:30:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:48 devstack sudo[105086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 Sep 28 12:30:48 devstack sudo[105086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:48 devstack sudo[105086]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" returned: 0 in 0.246s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" released by "_copy_volume_from_snapshot" :: held 8.583s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:48 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=72,cinder:UPDATE=84,cinder:INSERT=18,cinder:DELETE=6 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:30:48 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=59,cinder:UPDATE=90,cinder:DELETE=10,cinder:INSERT=23 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-21283955-6bd3-451c-a349-5609095a3674-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" released by "_create_volume_from_snapshot" :: held 8.659s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.677s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74b2b07d-b665-49dd-88c1-518976ff103a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1', 'volume_size': 1, 'snapshot_id': '21283955-6bd3-451c-a349-5609095a3674'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94616209-ba1d-4a9d-9f65-89d0a28cf8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:49 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Volume volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 (e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1): created successfully Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94616209-ba1d-4a9d-9f65-89d0a28cf8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Flow 'volume_create_manager' (20dbb96c-381a-4248-9dee-955a8bb8dbb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5be625f0-6903-4b76-a24c-bd4314473583 tempest-SnapshotDependencyTests-1787849270 None] Created volume successfully. Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "cinder-21283955-6bd3-451c-a349-5609095a3674-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-21283955-6bd3-451c-a349-5609095a3674-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "cinder-quobyte-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "cinder-quobyte-21283955-6bd3-451c-a349-5609095a3674" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-21283955-6bd3-451c-a349-5609095a3674" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Deleting offline snapshot 21283955-6bd3-451c-a349-5609095a3674 of volume 6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] snapshot_file for this snap is: volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cc8e3a-6c95-4b9d-a87f-6f5d4e5e4cea]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:49 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 Sep 28 12:30:49 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:49 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674" returned: 0 in 0.381s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6512d147-09f6-46f2-9e45-2e15b69ce04f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:49 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 Sep 28 12:30:49 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:50 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" returned: 0 in 0.543s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:50 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 Sep 28 12:30:50 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:50 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674" returned: 0 in 0.418s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:50 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674 Sep 28 12:30:50 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:51 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0.21283955-6bd3-451c-a349-5609095a3674" returned: 0 in 0.286s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-21283955-6bd3-451c-a349-5609095a3674" released by "_delete_snapshot" :: held 1.762s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" released by "delete_snapshot" :: held 1.790s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Created reservations ['26703893-edbe-43f1-821d-bdb84c99cdfe', '9e98bce9-ec4a-4ea7-abed-b9a2d35fd32f', '5217879b-f96f-4557-97f3-b0176eee4bff', 'e7db2819-27c8-47c1-bf2c-62da9dccfd3d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Delete snapshot completed successfully. Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8d37f0ae-6fe0-42ed-931c-235c5f8201c0 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-21283955-6bd3-451c-a349-5609095a3674-delete_snapshot" released by "delete_snapshot" :: held 2.001s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "cinder-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "cinder-quobyte-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e62f45-aacc-4dc4-b250-b3093f2fe7dd]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:51 devstack sudo[105109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 Sep 28 12:30:51 devstack sudo[105109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:52 devstack sudo[105109]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" returned: 0 in 0.380s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:52 devstack sudo[105114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0 Sep 28 12:30:52 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:52 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" returned: 0 in 0.262s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0" released by "delete_volume" :: held 0.731s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (0e3f3294-3141-41c0-b049-1064042ce3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869adb82-ebdc-435c-ba53-bfbfd35e0d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869adb82-ebdc-435c-ba53-bfbfd35e0d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1416024520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca09d0cd-0358-45b6-add6-be70d225409d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797ec4031c5e4808ac50cee49080a1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:52Z,use_quota=True,user_id='d17b6ea025684b7ea18a923f9c7fa9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8177fff-793b-4359-93fa-e5876b1463f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8177fff-793b-4359-93fa-e5876b1463f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b0a05c-59ca-4fa5-9755-4e5c6d059967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b0a05c-59ca-4fa5-9755-4e5c6d059967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca09d0cd-0358-45b6-add6-be70d225409d', 'volume_name': 'volume-ca09d0cd-0358-45b6-add6-be70d225409d', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b2a438-f0fe-4d26-ae0e-2c00c0bea087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b2a438-f0fe-4d26-ae0e-2c00c0bea087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d67b41-df96-4c75-8ace-aa1f6cf6b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:52 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume ca09d0cd-0358-45b6-add6-be70d225409d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca09d0cd-0358-45b6-add6-be70d225409d', 'volume_size': 1} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1416024520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca09d0cd-0358-45b6-add6-be70d225409d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797ec4031c5e4808ac50cee49080a1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:30:52Z,use_quota=True,user_id='d17b6ea025684b7ea18a923f9c7fa9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Creating volume ca09d0cd-0358-45b6-add6-be70d225409d {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:30:52 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:52 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d 1073741824 Sep 28 12:30:52 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Created reservations ['0a85f10b-28c5-4fa0-8094-ecfdad2a657b', '10ee7fe5-8520-4b16-a802-c37cf61b13bf', '1d6c50ea-d125-48cd-b156-78ee2d3fd40f', 'ca60ff46-8617-487d-a180-fc3ae50a7c3a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:52 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:52 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "cinder-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "cinder-quobyte-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe5b2c4-cba5-4cc4-821c-676e7674b86d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:52 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.317s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Deleted volume successfully. Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b4dbe811-c53f-4723-a764-a44a347111da tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-6fa7d8d6-9c4d-4b4d-bfe8-33541f66cca0-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:52 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 Sep 28 12:30:52 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:52 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d 1073741824" returned: 0 in 0.556s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:53 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d Sep 28 12:30:53 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:53 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" returned: 0 in 0.393s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:53 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1 Sep 28 12:30:53 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:53 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d" returned: 0 in 0.274s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27d67b41-df96-4c75-8ace-aa1f6cf6b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca09d0cd-0358-45b6-add6-be70d225409d', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3557212-5e3a-4404-86fc-0cbcb7630545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:30:53 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume volume-ca09d0cd-0358-45b6-add6-be70d225409d (ca09d0cd-0358-45b6-add6-be70d225409d): created successfully Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3557212-5e3a-4404-86fc-0cbcb7630545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (0e3f3294-3141-41c0-b049-1064042ce3a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:30:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-291c3dcc-624c-4d50-bdb2-e50403f93770 tempest-VolumesSnapshotTestJSON-2007937315 None] Created volume successfully. Sep 28 12:30:53 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" returned: 0 in 0.255s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-quobyte-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1" released by "delete_volume" :: held 0.708s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Created reservations ['90463e89-8688-4f8d-9722-759cac24a3ac', 'c49c3f13-fef8-45b8-9916-75e3c27e1ea6', '279e6359-6071-4e12-913d-88d03cbd765d', 'b11d3ea1-139a-41b4-8d55-cc42beccc723'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:53 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:30:53 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:53 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.261s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:30:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Deleted volume successfully. Sep 28 12:30:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-efca13e3-f3b5-4798-b65c-db85aab0b4a5 tempest-SnapshotDependencyTests-1787849270 None] Lock "cinder-e0f8b9e7-55be-4ab5-a1c7-08e3660b53e1-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:30:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:30:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Creating offline snapshot 771390ed-f1ae-4330-b12a-d4bc6d497ebb of volume ca09d0cd-0358-45b6-add6-be70d225409d {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:30:54 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b6014c-44e5-4a3a-bbf4-5a4b2afb9009]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:54 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d Sep 28 12:30:54 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:55 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d" returned: 0 in 0.399s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:55 devstack sudo[105148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb 1G Sep 28 12:30:55 devstack sudo[105148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:55 devstack sudo[105148]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb 1G" returned: 0 in 0.468s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca09d0cd-0358-45b6-add6-be70d225409d -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:55 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca09d0cd-0358-45b6-add6-be70d225409d -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb Sep 28 12:30:55 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:55 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca09d0cd-0358-45b6-add6-be70d225409d -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb" returned: 0 in 0.325s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:55 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb is being set with open permissions: ugo+rw Sep 28 12:30:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:56 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb Sep 28 12:30:56 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:56 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb" returned: 0 in 0.296s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:56 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.info Sep 28 12:30:56 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:56 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.info" returned: 0 in 0.280s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:56 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.info is being set with open permissions: ugo+rw Sep 28 12:30:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:56 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.info Sep 28 12:30:56 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:56 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.info" returned: 0 in 0.257s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.121s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:30:56 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-71bb1163-8e49-458e-9780-de8ba56563ad tempest-VolumesSnapshotTestJSON-2007937315 None] Create snapshot completed successfully Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-771390ed-f1ae-4330-b12a-d4bc6d497ebb-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-771390ed-f1ae-4330-b12a-d4bc6d497ebb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-ca09d0cd-0358-45b6-add6-be70d225409d" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-ca09d0cd-0358-45b6-add6-be70d225409d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-771390ed-f1ae-4330-b12a-d4bc6d497ebb" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-771390ed-f1ae-4330-b12a-d4bc6d497ebb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Deleting offline snapshot 771390ed-f1ae-4330-b12a-d4bc6d497ebb of volume ca09d0cd-0358-45b6-add6-be70d225409d {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] snapshot_file for this snap is: volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[11649f3e-6797-4698-b38c-f3cd8c0752f8]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:58 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb Sep 28 12:30:58 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:58 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb" returned: 0 in 0.421s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca09d0cd-0358-45b6-add6-be70d225409d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9feaa7-6a84-4fbb-a60c-babd3101abfe]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:30:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:58 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d Sep 28 12:30:58 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:59 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d" returned: 0 in 0.414s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:59 devstack sudo[105180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb Sep 28 12:30:59 devstack sudo[105180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:59 devstack sudo[105180]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb" returned: 0 in 0.384s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:30:59 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb Sep 28 12:30:59 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:30:59 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 28 12:30:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d.771390ed-f1ae-4330-b12a-d4bc6d497ebb" returned: 0 in 0.262s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:30:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-771390ed-f1ae-4330-b12a-d4bc6d497ebb" released by "_delete_snapshot" :: held 1.625s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-ca09d0cd-0358-45b6-add6-be70d225409d" released by "delete_snapshot" :: held 1.653s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:30:59 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Created reservations ['a3ca3b9f-824f-496c-b60a-7bc444cbccb7', 'fd08928c-e04c-4714-b646-0469b450455a', '2ece7ad0-084c-44c6-9f56-8f15adc3d3c7', '9361c7ac-ad7f-46e3-9fce-d4f4329a43c9'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:30:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Delete snapshot completed successfully. Sep 28 12:30:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-86f9d4f9-1d2d-47df-a340-6e69de480179 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-771390ed-f1ae-4330-b12a-d4bc6d497ebb-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (5aa00e58-d749-4793-97fd-2eb2bf2c808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5988712e-53f8-4c68-b32b-1855aeb358bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5988712e-53f8-4c68-b32b-1855aeb358bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1744989044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1dfd57-a30b-41c3-9092-0ef1c51336ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797ec4031c5e4808ac50cee49080a1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:01Z,use_quota=True,user_id='d17b6ea025684b7ea18a923f9c7fa9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89b6a09-e721-4369-b750-3bcb8aa49280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d89b6a09-e721-4369-b750-3bcb8aa49280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63ba6ab-a057-4ce8-8b76-2af85c533e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a63ba6ab-a057-4ce8-8b76-2af85c533e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1dfd57-a30b-41c3-9092-0ef1c51336ed', 'volume_name': 'volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0bdefb-cdf2-4048-89c8-b19101179989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0bdefb-cdf2-4048-89c8-b19101179989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726acee2-b4d0-4b8c-9950-54cb57dadb60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:00 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume 6d1dfd57-a30b-41c3-9092-0ef1c51336ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed', 'volume_size': 1} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1744989044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1dfd57-a30b-41c3-9092-0ef1c51336ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797ec4031c5e4808ac50cee49080a1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:01Z,use_quota=True,user_id='d17b6ea025684b7ea18a923f9c7fa9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Creating volume 6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:00 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:31:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:00 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed 1073741824 Sep 28 12:31:00 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:01 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed 1073741824" returned: 0 in 0.482s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:01 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed Sep 28 12:31:01 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:01 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" returned: 0 in 0.245s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726acee2-b4d0-4b8c-9950-54cb57dadb60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1f9543-cd25-45c3-aaee-daa05bf0f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:01 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed (6d1dfd57-a30b-41c3-9092-0ef1c51336ed): created successfully Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b1f9543-cd25-45c3-aaee-daa05bf0f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (5aa00e58-d749-4793-97fd-2eb2bf2c808f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-bad38fe0-0829-475a-9fa4-3330025cd0b3 tempest-VolumesSnapshotTestJSON-2007937315 None] Created volume successfully. Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Creating offline snapshot 2ab43da2-35df-4332-adae-94aa540f718c of volume 6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:31:02 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b46ba5e-29d9-4a9c-bc64-b101d416a6ef]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:02 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed Sep 28 12:31:02 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:02 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" returned: 0 in 0.400s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:02 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c 1G Sep 28 12:31:02 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:02 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c 1G" returned: 0 in 0.445s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:02 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c Sep 28 12:31:02 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:03 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c" returned: 0 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:03 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c is being set with open permissions: ugo+rw Sep 28 12:31:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:03 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c Sep 28 12:31:03 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:03 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c" returned: 0 in 0.256s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:03 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.info Sep 28 12:31:03 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:03 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.info" returned: 0 in 0.278s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:03 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.info is being set with open permissions: ugo+rw Sep 28 12:31:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:03 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.info Sep 28 12:31:03 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:04 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.info" returned: 0 in 0.302s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-22ace914-6fde-48b0-a1ed-2d4b0b5043a8 tempest-VolumesSnapshotTestJSON-2007937315 None] Create snapshot completed successfully Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (bf2310a5-8022-46b5-98b1-0b27b1725d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e91af-c423-4f1b-b6a1-f8982489048f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b2e91af-c423-4f1b-b6a1-f8982489048f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-43545223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c99dc2d-204b-42c8-bd16-bc24c9302d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797ec4031c5e4808ac50cee49080a1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:06Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2ab43da2-35df-4332-adae-94aa540f718c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:06Z,use_quota=True,user_id='d17b6ea025684b7ea18a923f9c7fa9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2815fe3-20ec-417e-ad89-051a12752d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2815fe3-20ec-417e-ad89-051a12752d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4497750d-2b23-42a8-b37b-39d3ec335723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4497750d-2b23-42a8-b37b-39d3ec335723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c99dc2d-204b-42c8-bd16-bc24c9302d68', 'volume_name': 'volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68', 'volume_size': 2, 'snapshot_id': '2ab43da2-35df-4332-adae-94aa540f718c'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e46263-8517-4ae8-91b5-b676a7731b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e46263-8517-4ae8-91b5-b676a7731b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c41801-9c6b-43dc-a9c1-de1e9030c165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume 0c99dc2d-204b-42c8-bd16-bc24c9302d68: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68', 'volume_size': 2, 'snapshot_id': '2ab43da2-35df-4332-adae-94aa540f718c'} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-2ab43da2-35df-4332-adae-94aa540f718c-0c99dc2d-204b-42c8-bd16-bc24c9302d68" by "_create_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-2ab43da2-35df-4332-adae-94aa540f718c-0c99dc2d-204b-42c8-bd16-bc24c9302d68" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Creating volume 0c99dc2d-204b-42c8-bd16-bc24c9302d68 from snapshot 2ab43da2-35df-4332-adae-94aa540f718c {{(pid=87048) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-0c99dc2d-204b-42c8-bd16-bc24c9302d68" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-0c99dc2d-204b-42c8-bd16-bc24c9302d68" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] snapshot: 2ab43da2-35df-4332-adae-94aa540f718c, volume: 0c99dc2d-204b-42c8-bd16-bc24c9302d68, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56cd2ee-6b5d-4d4b-abb1-bd30df04a474]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:05 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c Sep 28 12:31:05 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:06 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c" returned: 0 in 0.351s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:31:06 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2e22c5-8e1c-43e0-b186-6bbe4b0b28d1]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:06 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed Sep 28 12:31:06 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:06 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" returned: 0 in 0.352s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:31:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:31:06 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:31:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:06 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 Sep 28 12:31:06 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:12 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68" returned: 0 in 5.562s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed, size 1024.00 MB, duration 5.56 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:31:12 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Converted 1024.00 MB image at 184.07 MB/s Sep 28 12:31:12 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 is being set with open permissions: ugo+rw Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:12 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 Sep 28 12:31:12 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:12 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68" returned: 0 in 0.246s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-0c99dc2d-204b-42c8-bd16-bc24c9302d68" released by "_copy_volume_from_snapshot" :: held 6.590s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-2ab43da2-35df-4332-adae-94aa540f718c-0c99dc2d-204b-42c8-bd16-bc24c9302d68" released by "_create_volume_from_snapshot" :: held 6.662s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.676s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7c41801-9c6b-43dc-a9c1-de1e9030c165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68', 'volume_size': 2, 'snapshot_id': '2ab43da2-35df-4332-adae-94aa540f718c'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfd4ebf-ebab-410f-89dc-ef9543868cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:12 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 (0c99dc2d-204b-42c8-bd16-bc24c9302d68): created successfully Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcfd4ebf-ebab-410f-89dc-ef9543868cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (bf2310a5-8022-46b5-98b1-0b27b1725d8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0cb16675-7676-4804-bc3f-713f982233a3 tempest-VolumesSnapshotTestJSON-2007937315 None] Created volume successfully. Sep 28 12:31:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-0c99dc2d-204b-42c8-bd16-bc24c9302d68-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-0c99dc2d-204b-42c8-bd16-bc24c9302d68-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-0c99dc2d-204b-42c8-bd16-bc24c9302d68" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-0c99dc2d-204b-42c8-bd16-bc24c9302d68" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:13 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a60864-d48d-43a8-adff-bf872a566ad9]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:13 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 Sep 28 12:31:13 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:13 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68" returned: 0 in 0.357s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:13 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68 Sep 28 12:31:13 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:14 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0c99dc2d-204b-42c8-bd16-bc24c9302d68" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-0c99dc2d-204b-42c8-bd16-bc24c9302d68" released by "delete_volume" :: held 0.635s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Created reservations ['093e6e17-b4b3-4964-a776-e7c50ddf33d2', 'd186f8ac-f6e5-4a75-99e6-40218bf2c967', 'f5485efe-0a1e-4955-b2b9-4b4bdb9d6bf3', '99ff591c-2a10-4ad0-84a6-a1dc78a25fcf'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:14 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:14 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:14 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:14 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Deleted volume successfully. Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-34387c34-14ab-412a-864c-23de1cf6cd36 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-0c99dc2d-204b-42c8-bd16-bc24c9302d68-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-2ab43da2-35df-4332-adae-94aa540f718c-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-2ab43da2-35df-4332-adae-94aa540f718c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-2ab43da2-35df-4332-adae-94aa540f718c" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-2ab43da2-35df-4332-adae-94aa540f718c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Deleting offline snapshot 2ab43da2-35df-4332-adae-94aa540f718c of volume 6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] snapshot_file for this snap is: volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbba37ac-a386-44a6-aed3-fda6cbc33e8c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:14 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c Sep 28 12:31:14 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:15 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c" returned: 0 in 0.367s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:31:15 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54adb24-46c3-4268-b1d8-5b4d1165a82c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:15 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed Sep 28 12:31:15 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:15 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" returned: 0 in 0.535s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:15 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c Sep 28 12:31:15 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:15 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c" returned: 0 in 0.339s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:15 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c Sep 28 12:31:15 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:16 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed.2ab43da2-35df-4332-adae-94aa540f718c" returned: 0 in 0.250s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-2ab43da2-35df-4332-adae-94aa540f718c" released by "_delete_snapshot" :: held 1.592s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" released by "delete_snapshot" :: held 1.613s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Created reservations ['990627ea-7d8c-43ad-9577-0b9e84ba2069', '6c4b8473-02f0-4f31-81d9-f9aea46600a8', 'fe3498d0-bb82-460c-a2d7-4825caeddc0e', '5194f29b-7c46-4762-8b6a-ba8813e3cf42'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Delete snapshot completed successfully. Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6c56d0c7-fc4f-4ecb-b789-90f690a0601f tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-2ab43da2-35df-4332-adae-94aa540f718c-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-6d1dfd57-a30b-41c3-9092-0ef1c51336ed-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-6d1dfd57-a30b-41c3-9092-0ef1c51336ed-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[32577985-2624-448a-b9a2-e5446afb784d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:16 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed Sep 28 12:31:16 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:17 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" returned: 0 in 0.372s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:17 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed Sep 28 12:31:17 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:17 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" returned: 0 in 0.268s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-6d1dfd57-a30b-41c3-9092-0ef1c51336ed" released by "delete_volume" :: held 0.702s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Created reservations ['1bd5dcae-0fae-4584-bd31-b5eb8a141253', '32e5e535-5659-4cf8-9329-63298347b8b8', '1f09f068-1c17-4886-827b-e4e94c63f346', '3e0674d9-3b9d-4760-9468-192cffb43513'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:17 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:17 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:17 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.249s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Deleted volume successfully. Sep 28 12:31:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-de35998b-55d9-4b2d-9a11-47f494f60996 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-6d1dfd57-a30b-41c3-9092-0ef1c51336ed-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (607cfcca-7cfa-4c54-ab50-932e3dc0190c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d1cb9c-b0b3-4923-986c-218e9a8c0d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d1cb9c-b0b3-4923-986c-218e9a8c0d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-456657696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2ac42a-c1c1-4774-84cb-b24a60917795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797ec4031c5e4808ac50cee49080a1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:18Z,use_quota=True,user_id='d17b6ea025684b7ea18a923f9c7fa9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b128354d-ee2e-4c46-ac12-9081c45fce86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b128354d-ee2e-4c46-ac12-9081c45fce86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60110d4-20fd-4663-984b-4013f8a4d8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60110d4-20fd-4663-984b-4013f8a4d8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c2ac42a-c1c1-4774-84cb-b24a60917795', 'volume_name': 'volume-7c2ac42a-c1c1-4774-84cb-b24a60917795', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22aaa08-30c1-40e3-b81f-d93f54ded442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c22aaa08-30c1-40e3-b81f-d93f54ded442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1edb8e-fa44-406b-9960-18764bdfbe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume 7c2ac42a-c1c1-4774-84cb-b24a60917795: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c2ac42a-c1c1-4774-84cb-b24a60917795', 'volume_size': 1} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-456657696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c2ac42a-c1c1-4774-84cb-b24a60917795,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797ec4031c5e4808ac50cee49080a1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:18Z,use_quota=True,user_id='d17b6ea025684b7ea18a923f9c7fa9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Creating volume 7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:18 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:18 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 1073741824 Sep 28 12:31:18 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:18 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 1073741824" returned: 0 in 0.396s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:18 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 Sep 28 12:31:18 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:19 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] <== create_volume: return (668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e1edb8e-fa44-406b-9960-18764bdfbe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c2ac42a-c1c1-4774-84cb-b24a60917795', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0768e37c-b56b-4218-95b5-5e0dd350d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:19 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 (7c2ac42a-c1c1-4774-84cb-b24a60917795): created successfully Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0768e37c-b56b-4218-95b5-5e0dd350d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (607cfcca-7cfa-4c54-ab50-932e3dc0190c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:19 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4af29012-f8d3-40f6-a3a1-f5986c9ed3e2 tempest-VolumesSnapshotTestJSON-2007937315 None] Created volume successfully. Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Creating offline snapshot fa2dc59f-5367-4cde-907f-d5827fb919ff of volume 7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[862ac58c-6246-4610-99aa-fc389ed4b049]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:19 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 Sep 28 12:31:19 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:19 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795" returned: 0 in 0.368s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:19 devstack sudo[105352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff 1G Sep 28 12:31:19 devstack sudo[105352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:20 devstack sudo[105352]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff 1G" returned: 0 in 0.369s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:20 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff Sep 28 12:31:20 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:20 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff" returned: 0 in 0.281s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:20 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff is being set with open permissions: ugo+rw Sep 28 12:31:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:20 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff Sep 28 12:31:20 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:20 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff" returned: 0 in 0.239s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:20 devstack sudo[105367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.info Sep 28 12:31:20 devstack sudo[105367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:21 devstack sudo[105367]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.info" returned: 0 in 0.240s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:21 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.info is being set with open permissions: ugo+rw Sep 28 12:31:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:21 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.info Sep 28 12:31:21 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:21 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.info" returned: 0 in 0.231s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.814s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:21 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3210899e-d5c0-4100-9423-bea5531d460c tempest-VolumesSnapshotTestJSON-2007937315 None] Create snapshot completed successfully Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (462094f6-d845-4e21-9459-1853f45bd8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824ca968-001c-4a9a-9139-831d67c22545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (824ca968-001c-4a9a-9139-831d67c22545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1810803466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fc6e79-e641-4c77-a849-2bb84774fc8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='797ec4031c5e4808ac50cee49080a1ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa2dc59f-5367-4cde-907f-d5827fb919ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:22Z,use_quota=True,user_id='d17b6ea025684b7ea18a923f9c7fa9b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf38489b-7776-417f-a829-1195006fff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf38489b-7776-417f-a829-1195006fff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36745028-52fb-4e94-812e-9e143050b5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36745028-52fb-4e94-812e-9e143050b5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84fc6e79-e641-4c77-a849-2bb84774fc8d', 'volume_name': 'volume-84fc6e79-e641-4c77-a849-2bb84774fc8d', 'volume_size': 1, 'snapshot_id': 'fa2dc59f-5367-4cde-907f-d5827fb919ff'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f799972c-67a7-4b3c-b05b-5da6f7cf9407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f799972c-67a7-4b3c-b05b-5da6f7cf9407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fb823d-4350-4a8b-95d2-0190da79f605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:22 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume 84fc6e79-e641-4c77-a849-2bb84774fc8d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84fc6e79-e641-4c77-a849-2bb84774fc8d', 'volume_size': 1, 'snapshot_id': 'fa2dc59f-5367-4cde-907f-d5827fb919ff'} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-fa2dc59f-5367-4cde-907f-d5827fb919ff-84fc6e79-e641-4c77-a849-2bb84774fc8d" by "_create_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-fa2dc59f-5367-4cde-907f-d5827fb919ff-84fc6e79-e641-4c77-a849-2bb84774fc8d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Creating volume 84fc6e79-e641-4c77-a849-2bb84774fc8d from snapshot fa2dc59f-5367-4cde-907f-d5827fb919ff {{(pid=87048) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-84fc6e79-e641-4c77-a849-2bb84774fc8d" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-84fc6e79-e641-4c77-a849-2bb84774fc8d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] snapshot: fa2dc59f-5367-4cde-907f-d5827fb919ff, volume: 84fc6e79-e641-4c77-a849-2bb84774fc8d, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3781c1-679a-456b-8db0-4bd56daa37cf]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:22 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff Sep 28 12:31:22 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:22 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff" returned: 0 in 0.352s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2ac42a-c1c1-4774-84cb-b24a60917795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[da53987d-9512-49c3-98ae-de0f1a164d27]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:22 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 Sep 28 12:31:22 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:23 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795" returned: 0 in 0.359s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:31:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:31:23 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:31:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:23 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d Sep 28 12:31:23 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:28 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d" returned: 0 in 5.567s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795, size 1024.00 MB, duration 5.57 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:31:28 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Converted 1024.00 MB image at 183.91 MB/s Sep 28 12:31:28 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d is being set with open permissions: ugo+rw Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:28 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d Sep 28 12:31:28 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:28 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d" returned: 0 in 0.232s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-84fc6e79-e641-4c77-a849-2bb84774fc8d" released by "_copy_volume_from_snapshot" :: held 6.583s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-fa2dc59f-5367-4cde-907f-d5827fb919ff-84fc6e79-e641-4c77-a849-2bb84774fc8d" released by "_create_volume_from_snapshot" :: held 6.655s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.673s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fb823d-4350-4a8b-95d2-0190da79f605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fc6e79-e641-4c77-a849-2bb84774fc8d', 'volume_size': 1, 'snapshot_id': 'fa2dc59f-5367-4cde-907f-d5827fb919ff'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6535097e-7746-4634-b519-b77a91572c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:28 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Volume volume-84fc6e79-e641-4c77-a849-2bb84774fc8d (84fc6e79-e641-4c77-a849-2bb84774fc8d): created successfully Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6535097e-7746-4634-b519-b77a91572c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Flow 'volume_create_manager' (462094f6-d845-4e21-9459-1853f45bd8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a9160751-3a58-4ebb-9b67-2af0934b1274 tempest-VolumesSnapshotTestJSON-2007937315 None] Created volume successfully. Sep 28 12:31:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-84fc6e79-e641-4c77-a849-2bb84774fc8d-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-84fc6e79-e641-4c77-a849-2bb84774fc8d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-84fc6e79-e641-4c77-a849-2bb84774fc8d" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-84fc6e79-e641-4c77-a849-2bb84774fc8d" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:29 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b9e130-0021-4e1d-ad8d-f0aee293699e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:30 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d Sep 28 12:31:30 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:30 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d" returned: 0 in 0.355s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:30 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d Sep 28 12:31:30 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:30 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-84fc6e79-e641-4c77-a849-2bb84774fc8d" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-84fc6e79-e641-4c77-a849-2bb84774fc8d" released by "delete_volume" :: held 0.630s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Created reservations ['a4eae303-1e54-4f7e-ad3e-460f7dbc15e9', '9d1e6abe-56d4-4385-9d42-fa84b8ceafd3', '2dd45335-d197-4d83-807e-020244a21a78', '2248daa0-894b-4663-a78e-90f988e20cfa'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:30 devstack sudo[105411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:30 devstack sudo[105411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:30 devstack sudo[105411]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.233s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:30 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Deleted volume successfully. Sep 28 12:31:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-982befef-ffb5-4aab-872a-150ca992fa10 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-84fc6e79-e641-4c77-a849-2bb84774fc8d-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-fa2dc59f-5367-4cde-907f-d5827fb919ff-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-fa2dc59f-5367-4cde-907f-d5827fb919ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-7c2ac42a-c1c1-4774-84cb-b24a60917795" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-7c2ac42a-c1c1-4774-84cb-b24a60917795" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-fa2dc59f-5367-4cde-907f-d5827fb919ff" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-fa2dc59f-5367-4cde-907f-d5827fb919ff" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Deleting offline snapshot fa2dc59f-5367-4cde-907f-d5827fb919ff of volume 7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] snapshot_file for this snap is: volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a45fc6-5550-4f6f-aab5-ce5eb427afbb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:31 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff Sep 28 12:31:31 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:31 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff" returned: 0 in 0.347s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c2ac42a-c1c1-4774-84cb-b24a60917795(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[410d4316-57e3-45b7-ac70-39f99bcc2aff]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:31 devstack sudo[105419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 Sep 28 12:31:31 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:31 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795" returned: 0 in 0.513s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:32 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff Sep 28 12:31:32 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:32 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff" returned: 0 in 0.342s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:32 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff Sep 28 12:31:32 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:32 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795.fa2dc59f-5367-4cde-907f-d5827fb919ff" returned: 0 in 0.245s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-fa2dc59f-5367-4cde-907f-d5827fb919ff" released by "_delete_snapshot" :: held 1.555s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-7c2ac42a-c1c1-4774-84cb-b24a60917795" released by "delete_snapshot" :: held 1.577s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Created reservations ['2cbf741a-7ec1-4af1-b707-3563e864ab91', '402fd53c-9085-41ae-8c03-89d7390c46d7', '320d9ecc-d1c9-404f-aa95-bc48f0252a6a', '859b434a-7a0a-4040-8414-a4021cad4f2f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:32 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Delete snapshot completed successfully. Sep 28 12:31:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82c5fd4e-e327-4cbf-9cb2-9239883e1698 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-fa2dc59f-5367-4cde-907f-d5827fb919ff-delete_snapshot" released by "delete_snapshot" :: held 1.706s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-7c2ac42a-c1c1-4774-84cb-b24a60917795-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-7c2ac42a-c1c1-4774-84cb-b24a60917795-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-7c2ac42a-c1c1-4774-84cb-b24a60917795" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-7c2ac42a-c1c1-4774-84cb-b24a60917795" acquired by "delete_volume" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[77874abe-f575-4fe0-b5ec-2449b961cf0d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:33 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 Sep 28 12:31:33 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:33 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795" returned: 0 in 0.355s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:33 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795 Sep 28 12:31:33 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:33 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7c2ac42a-c1c1-4774-84cb-b24a60917795" returned: 0 in 0.245s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-7c2ac42a-c1c1-4774-84cb-b24a60917795" released by "delete_volume" :: held 0.660s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:33 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Created reservations ['d6764a7a-2635-45b5-a57b-a629c4b0f399', '0f0b5ea2-92e0-4bfb-b1cc-461a14a554d8', 'bd18a6b4-6cfa-4efb-9748-1dc1999618a0', '7083423a-71d6-43b5-b335-ac6323e251ca'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:34 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:34 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:34 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.232s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Deleted volume successfully. Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f6065697-9db3-42c9-b77b-e265b663d167 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-7c2ac42a-c1c1-4774-84cb-b24a60917795-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-ca09d0cd-0358-45b6-add6-be70d225409d-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-ca09d0cd-0358-45b6-add6-be70d225409d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "cinder-quobyte-ca09d0cd-0358-45b6-add6-be70d225409d" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-ca09d0cd-0358-45b6-add6-be70d225409d" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2fe554-3daa-41c5-8241-4c35f467243a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:34 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d Sep 28 12:31:34 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:34 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d" returned: 0 in 0.357s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:34 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d Sep 28 12:31:34 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:35 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ca09d0cd-0358-45b6-add6-be70d225409d" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-quobyte-ca09d0cd-0358-45b6-add6-be70d225409d" released by "delete_volume" :: held 0.652s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Created reservations ['9ea96864-9a38-4765-8ff6-b30154a1155c', '8d6cccae-7f94-4cb2-a078-28d0b824208d', 'eb963e28-7916-42fe-8f0d-2c46f1cefcdc', 'bf2c05d2-bb8e-45be-9f5f-c12a0e76b399'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:35 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:35 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:35 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.230s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Deleted volume successfully. Sep 28 12:31:35 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-b319cdf5-172a-4e66-a388-f0c13a3bdc70 tempest-VolumesSnapshotTestJSON-2007937315 None] Lock "cinder-ca09d0cd-0358-45b6-add6-be70d225409d-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:38 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:38 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:38 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.276s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:31:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (9d357f32-c0fb-4a48-930a-bc09174ef897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a0213a-7024-439b-911f-582429e9e4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84a0213a-7024-439b-911f-582429e9e4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1430771022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee38f4d-81b5-45f1-86d9-90d6962fe076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:43Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b403d9d-b955-437c-8ec5-c8a2a7b73144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b403d9d-b955-437c-8ec5-c8a2a7b73144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a303ba97-6daf-4cb2-b97c-a4fdc5b758e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a303ba97-6daf-4cb2-b97c-a4fdc5b758e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee38f4d-81b5-45f1-86d9-90d6962fe076', 'volume_name': 'volume-eee38f4d-81b5-45f1-86d9-90d6962fe076', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f53d153-1de5-43e8-92e2-cf3fe35eec76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f53d153-1de5-43e8-92e2-cf3fe35eec76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c90d4fc-63ed-4c2a-b9ed-db679e3fc739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:42 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Volume eee38f4d-81b5-45f1-86d9-90d6962fe076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee38f4d-81b5-45f1-86d9-90d6962fe076', 'volume_size': 1} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1430771022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee38f4d-81b5-45f1-86d9-90d6962fe076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:43Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Creating volume eee38f4d-81b5-45f1-86d9-90d6962fe076 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:42 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:31:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:42 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 1073741824 Sep 28 12:31:42 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (3d34782c-ac75-4ae5-b3eb-ee7954cc2383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e0432e-c7d7-4c28-91b9-156e2eab90b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4e0432e-c7d7-4c28-91b9-156e2eab90b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981436616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ad350c-f237-49a9-a0b3-55921a5e88b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:43Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c759185a-7fe1-4f09-bd44-0c7be72f32cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c759185a-7fe1-4f09-bd44-0c7be72f32cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c94ec89-f1c6-41b5-80dc-1c7c47ab6fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c94ec89-f1c6-41b5-80dc-1c7c47ab6fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ad350c-f237-49a9-a0b3-55921a5e88b3', 'volume_name': 'volume-94ad350c-f237-49a9-a0b3-55921a5e88b3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e426029-6f36-414b-9c51-cb9f1fe4658c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e426029-6f36-414b-9c51-cb9f1fe4658c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7253b8-8f0d-4ed1-ad8e-4bb8464b150e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Volume 94ad350c-f237-49a9-a0b3-55921a5e88b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ad350c-f237-49a9-a0b3-55921a5e88b3', 'volume_size': 1} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:43 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 1073741824" returned: 0 in 0.513s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:43 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 Sep 28 12:31:43 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (fc0d908d-f30d-4ddf-97b1-135b17e5d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f78a64-fbd3-41e7-a7fe-898e7179598d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f78a64-fbd3-41e7-a7fe-898e7179598d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1159234206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d25e4e-398e-49f8-9319-e8350e3d5f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:43Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd17d070-5ebe-4c28-8d5b-af7eff48877b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd17d070-5ebe-4c28-8d5b-af7eff48877b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7923881d-dfa3-402f-bef4-5f50928efd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7923881d-dfa3-402f-bef4-5f50928efd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1d25e4e-398e-49f8-9319-e8350e3d5f5f', 'volume_name': 'volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a222c85-34b7-42bf-9fcc-b0334f7e89ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a222c85-34b7-42bf-9fcc-b0334f7e89ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12239eb4-17fe-47af-9606-e4ea8d3bea77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Volume a1d25e4e-398e-49f8-9319-e8350e3d5f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f', 'volume_size': 1} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:43 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076" returned: 0 in 0.303s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981436616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94ad350c-f237-49a9-a0b3-55921a5e88b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:43Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Creating volume 94ad350c-f237-49a9-a0b3-55921a5e88b3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:43 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:43 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 1073741824 Sep 28 12:31:43 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c90d4fc-63ed-4c2a-b9ed-db679e3fc739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee38f4d-81b5-45f1-86d9-90d6962fe076', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd99e10e-5b9d-4c5a-ba28-d45841cd5423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Volume volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 (eee38f4d-81b5-45f1-86d9-90d6962fe076): created successfully Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd99e10e-5b9d-4c5a-ba28-d45841cd5423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (9d357f32-c0fb-4a48-930a-bc09174ef897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-53b790e3-2560-47ca-830b-a4ef85b0b74c tempest-CreateVolumesFromImageTest-1110455389 None] Created volume successfully. Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (282db063-eb35-4194-a247-e8fbedc9df2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422e4b21-ddf7-4193-944f-1fa132d036bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422e4b21-ddf7-4193-944f-1fa132d036bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-8022900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ead0e87-a871-40f4-83ab-0aea50da7253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:44Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b845ed8d-13e7-42da-a7b2-9250cc4f9cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b845ed8d-13e7-42da-a7b2-9250cc4f9cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cb590a-cc24-429b-8d06-51a055db29fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cb590a-cc24-429b-8d06-51a055db29fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ead0e87-a871-40f4-83ab-0aea50da7253', 'volume_name': 'volume-3ead0e87-a871-40f4-83ab-0aea50da7253', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8eb0d73-591d-43d0-a1e6-2dda00297021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8eb0d73-591d-43d0-a1e6-2dda00297021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b3455f-bd4f-4b94-9254-617b43839af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:43 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Volume 3ead0e87-a871-40f4-83ab-0aea50da7253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ead0e87-a871-40f4-83ab-0aea50da7253', 'volume_size': 1} Sep 28 12:31:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:44 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 1073741824" returned: 0 in 0.538s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (8668bbcd-b567-4f65-b9f8-9d22e9e500ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce47eb9-b85e-4e78-b65f-272d64fed179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fce47eb9-b85e-4e78-b65f-272d64fed179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-694506213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52f9a39-a681-472d-a1d2-591a3a53f93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:44Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:44 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 Sep 28 12:31:44 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992500cb-1089-47a6-a2a8-c9df4613a634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992500cb-1089-47a6-a2a8-c9df4613a634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c3d9e5-42b8-44d2-8c5a-411bd8e1b785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c3d9e5-42b8-44d2-8c5a-411bd8e1b785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e52f9a39-a681-472d-a1d2-591a3a53f93f', 'volume_name': 'volume-e52f9a39-a681-472d-a1d2-591a3a53f93f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732fc5cc-e228-4450-afde-9996f5e8cc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732fc5cc-e228-4450-afde-9996f5e8cc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01df838b-1e9c-4e8a-acea-620145bc9bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:44 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Volume e52f9a39-a681-472d-a1d2-591a3a53f93f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e52f9a39-a681-472d-a1d2-591a3a53f93f', 'volume_size': 1} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:44 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3" returned: 0 in 0.270s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.038s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1159234206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1d25e4e-398e-49f8-9319-e8350e3d5f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:43Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Creating volume a1d25e4e-398e-49f8-9319-e8350e3d5f5f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:44 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:44 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f 1073741824 Sep 28 12:31:44 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a7253b8-8f0d-4ed1-ad8e-4bb8464b150e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ad350c-f237-49a9-a0b3-55921a5e88b3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902e512c-5940-4755-ac73-0730af680a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:44 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Volume volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 (94ad350c-f237-49a9-a0b3-55921a5e88b3): created successfully Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (902e512c-5940-4755-ac73-0730af680a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (3d34782c-ac75-4ae5-b3eb-ee7954cc2383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6e000e56-6d27-44de-8a71-417824645c2b tempest-CreateVolumesFromImageTest-1110455389 None] Created volume successfully. Sep 28 12:31:45 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f 1073741824" returned: 0 in 0.421s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:45 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f Sep 28 12:31:45 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:45 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f" returned: 0 in 0.245s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.336s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-8022900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ead0e87-a871-40f4-83ab-0aea50da7253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:44Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Creating volume 3ead0e87-a871-40f4-83ab-0aea50da7253 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:45 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12239eb4-17fe-47af-9606-e4ea8d3bea77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:45 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253 1073741824 Sep 28 12:31:45 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ba151d-adac-4625-9736-a01cc1a3a939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:45 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Volume volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f (a1d25e4e-398e-49f8-9319-e8350e3d5f5f): created successfully Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ba151d-adac-4625-9736-a01cc1a3a939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (fc0d908d-f30d-4ddf-97b1-135b17e5d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-fd7b2c09-0c4b-4eb7-ad11-cbe189d6dc58 tempest-CreateVolumesFromImageTest-1110455389 None] Created volume successfully. Sep 28 12:31:45 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253 1073741824" returned: 0 in 0.427s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:45 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253 Sep 28 12:31:45 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:46 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253" returned: 0 in 0.261s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] <== create_volume: return (726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.651s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-694506213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e52f9a39-a681-472d-a1d2-591a3a53f93f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b08094d4bfc426abe88ca467be8f263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:44Z,use_quota=True,user_id='1865b32f44c54754b3463e6e64487ca6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Creating volume e52f9a39-a681-472d-a1d2-591a3a53f93f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:46 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b3455f-bd4f-4b94-9254-617b43839af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ead0e87-a871-40f4-83ab-0aea50da7253', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:46 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f 1073741824 Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e0a227-1db0-498a-ab86-dfa193a8ac1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:46 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:46 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Volume volume-3ead0e87-a871-40f4-83ab-0aea50da7253 (3ead0e87-a871-40f4-83ab-0aea50da7253): created successfully Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e0a227-1db0-498a-ab86-dfa193a8ac1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (282db063-eb35-4194-a247-e8fbedc9df2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b914f7bd-0832-4bba-8592-e0311250cf09 tempest-CreateVolumesFromImageTest-1110455389 None] Created volume successfully. Sep 28 12:31:46 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f 1073741824" returned: 0 in 0.448s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:46 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f Sep 28 12:31:46 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:46 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f" returned: 0 in 0.242s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01df838b-1e9c-4e8a-acea-620145bc9bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e52f9a39-a681-472d-a1d2-591a3a53f93f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b902bfd2-14ea-4f75-94dd-7de07b698c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:46 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Volume volume-e52f9a39-a681-472d-a1d2-591a3a53f93f (e52f9a39-a681-472d-a1d2-591a3a53f93f): created successfully Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b902bfd2-14ea-4f75-94dd-7de07b698c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Flow 'volume_create_manager' (8668bbcd-b567-4f65-b9f8-9d22e9e500ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-65f73541-685f-4c6c-a200-7a0dc6decabd tempest-CreateVolumesFromImageTest-1110455389 None] Created volume successfully. Sep 28 12:31:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-e52f9a39-a681-472d-a1d2-591a3a53f93f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-e52f9a39-a681-472d-a1d2-591a3a53f93f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-quobyte-e52f9a39-a681-472d-a1d2-591a3a53f93f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-e52f9a39-a681-472d-a1d2-591a3a53f93f" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:47 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8189d62-43c5-4fa1-8911-c45d45672e25]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:47 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f Sep 28 12:31:47 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:48 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f" returned: 0 in 0.366s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:48 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f Sep 28 12:31:48 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:48 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e52f9a39-a681-472d-a1d2-591a3a53f93f" returned: 0 in 0.235s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-e52f9a39-a681-472d-a1d2-591a3a53f93f" released by "delete_volume" :: held 0.639s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Created reservations ['f6acf101-8440-4dd2-aad6-d1d848b51fa5', 'a7438673-e8d3-4dc9-ac23-c25e778095f7', '447a6882-5bd7-4ee4-847f-e6c83b0d0ade', '7b72ba20-ae59-4056-92a0-fd1c80a457a3'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:48 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:48 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:48 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.244s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Deleted volume successfully. Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18f014db-b47f-45dc-b66a-d91fd3e20714 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-e52f9a39-a681-472d-a1d2-591a3a53f93f-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-3ead0e87-a871-40f4-83ab-0aea50da7253-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-3ead0e87-a871-40f4-83ab-0aea50da7253-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-quobyte-3ead0e87-a871-40f4-83ab-0aea50da7253" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-3ead0e87-a871-40f4-83ab-0aea50da7253" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[480d8cc4-a58f-4106-b382-474ff5e840e1]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:49 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253 Sep 28 12:31:49 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:49 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253" returned: 0 in 0.357s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:49 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253 Sep 28 12:31:49 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:49 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3ead0e87-a871-40f4-83ab-0aea50da7253" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-3ead0e87-a871-40f4-83ab-0aea50da7253" released by "delete_volume" :: held 0.630s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=101,cinder:INSERT=25,cinder:UPDATE=126,cinder:DELETE=14 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=109,cinder:UPDATE=122,cinder:DELETE=8,cinder:INSERT=37 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Created reservations ['2747e170-f643-4f7d-84a5-f9ed15b3438d', '898317c9-1dc0-422b-871b-bb86ddbf4068', 'ccd7409b-febd-476b-b3f2-4baf855eb8f7', 'dabf0e6f-1c11-4c09-934d-3afe0c3452c6'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:49 devstack sudo[105524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:49 devstack sudo[105524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:49 devstack sudo[105524]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.232s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Deleted volume successfully. Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5e8fe406-4683-43f0-9bbc-af413ef808c6 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-3ead0e87-a871-40f4-83ab-0aea50da7253-delete_volume" released by "delete_volume" :: held 1.053s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-a1d25e4e-398e-49f8-9319-e8350e3d5f5f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-a1d25e4e-398e-49f8-9319-e8350e3d5f5f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-quobyte-a1d25e4e-398e-49f8-9319-e8350e3d5f5f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-a1d25e4e-398e-49f8-9319-e8350e3d5f5f" acquired by "delete_volume" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cafb7b2-5935-4faf-be4d-ebada04f3046]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:50 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f Sep 28 12:31:50 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:50 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f" returned: 0 in 0.350s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:50 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f Sep 28 12:31:50 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:50 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a1d25e4e-398e-49f8-9319-e8350e3d5f5f" returned: 0 in 0.238s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-a1d25e4e-398e-49f8-9319-e8350e3d5f5f" released by "delete_volume" :: held 0.632s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Created reservations ['9c66277f-c0dc-4dde-80b1-7cae41c72e80', 'e15330c9-6332-45d6-8d45-a37fa02c2108', '7e9eaeab-07b1-4c13-994e-c964a3e20401', '2afbe5cc-a308-4e6b-8d28-9c65e5c6a57a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:50 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:50 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:51 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.237s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Deleted volume successfully. Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f52c3ac7-817d-4ac6-ae05-a08d96caabef tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-a1d25e4e-398e-49f8-9319-e8350e3d5f5f-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-94ad350c-f237-49a9-a0b3-55921a5e88b3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-94ad350c-f237-49a9-a0b3-55921a5e88b3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-quobyte-94ad350c-f237-49a9-a0b3-55921a5e88b3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-94ad350c-f237-49a9-a0b3-55921a5e88b3" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0f88b8-9c74-469e-b674-df144cc851d1]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:51 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 Sep 28 12:31:51 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:51 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3" returned: 0 in 0.347s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:51 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3 Sep 28 12:31:51 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:51 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-94ad350c-f237-49a9-a0b3-55921a5e88b3" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-94ad350c-f237-49a9-a0b3-55921a5e88b3" released by "delete_volume" :: held 0.621s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Created reservations ['25133e41-e53a-4bfe-802e-1fdc62d7c064', '19d4daab-218b-4b40-b1bc-b3138125dfa1', 'af69f2ff-46ee-4518-977b-2080f61e7605', '4a4bb276-f593-4aea-bd9e-14d261eac24e'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:51 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:51 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:52 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.234s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Deleted volume successfully. Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-220f4eba-7e45-4495-b388-0aafdb99c8e0 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-94ad350c-f237-49a9-a0b3-55921a5e88b3-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-eee38f4d-81b5-45f1-86d9-90d6962fe076-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-eee38f4d-81b5-45f1-86d9-90d6962fe076-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "cinder-quobyte-eee38f4d-81b5-45f1-86d9-90d6962fe076" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-eee38f4d-81b5-45f1-86d9-90d6962fe076" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14ae5ce-1f00-4841-842b-291294e39538]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:52 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 Sep 28 12:31:52 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:52 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076" returned: 0 in 0.349s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:52 devstack sudo[105555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076 Sep 28 12:31:52 devstack sudo[105555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:52 devstack sudo[105555]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-eee38f4d-81b5-45f1-86d9-90d6962fe076" returned: 0 in 0.244s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-quobyte-eee38f4d-81b5-45f1-86d9-90d6962fe076" released by "delete_volume" :: held 0.636s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Created reservations ['7a403c25-b1b3-4213-a1dc-7c5533b9f435', 'b108dde7-dff4-4a3d-8893-664e6b6588e2', '21e92d69-5cb5-4372-ad13-afe8e582e28e', '0cd9e383-a5e7-4e82-8896-2198a360229b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:53 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:31:53 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:53 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.231s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:31:53 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Deleted volume successfully. Sep 28 12:31:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d362ff55-1cb4-43ac-a20d-de5cc539d123 tempest-CreateVolumesFromImageTest-1110455389 None] Lock "cinder-eee38f4d-81b5-45f1-86d9-90d6962fe076-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Flow 'volume_create_manager' (3f728096-757a-4276-934f-ef629d24321f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebdcce9-4f49-4f68-9538-098456cc1f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cebdcce9-4f49-4f68-9538-098456cc1f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04edc1a-93b5-421f-9394-8e8261396798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204cd17415514350a456633dec66efc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:58Z,use_quota=True,user_id='8b999ae431d24f33b0c111efe3a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14d72f4-ae8a-4274-8474-6a18fc3e22e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14d72f4-ae8a-4274-8474-6a18fc3e22e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03b5dad-550a-4a2a-b11b-7a6ac8463221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c03b5dad-550a-4a2a-b11b-7a6ac8463221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e04edc1a-93b5-421f-9394-8e8261396798', 'volume_name': 'volume-e04edc1a-93b5-421f-9394-8e8261396798', 'volume_size': 1, 'image_id': 'e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd04cbc969a22ade28eec54ac905c0292', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '204cd17415514350a456633dec66efc0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8d9bbb1cb54790d306bb6c1e44ec02fdbcb0178b76694214b10733447ae879286da059c320867771191eac2018771e0a3a708b5f167859bb49186becb96cbb7', 'id': 'e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'created_at': datetime.datetime(2026, 9, 28, 10, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e341e1af-1141-4121-b8a2-ceb8bd1fb3ee/file', 'properties': {}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac88a52-6c1e-46a8-8f09-41f681043389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ac88a52-6c1e-46a8-8f09-41f681043389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ab1ea9-fd9f-4fb0-988c-ee3af21a5253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:31:58 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Volume e04edc1a-93b5-421f-9394-8e8261396798: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e04edc1a-93b5-421f-9394-8e8261396798', 'volume_size': 1, 'image_id': 'e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd04cbc969a22ade28eec54ac905c0292', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '204cd17415514350a456633dec66efc0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8d9bbb1cb54790d306bb6c1e44ec02fdbcb0178b76694214b10733447ae879286da059c320867771191eac2018771e0a3a708b5f167859bb49186becb96cbb7', 'id': 'e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'created_at': datetime.datetime(2026, 9, 28, 10, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e341e1af-1141-4121-b8a2-ceb8bd1fb3ee/file', 'properties': {}}, 'image_service': } Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Trying to clone e04edc1a-93b5-421f-9394-8e8261396798 from image e341e1af-1141-4121-b8a2-ceb8bd1fb3ee at location (None, [{'url': 'file:///opt/stack/data/glance/images/e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:31:58 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a42024-9635-42df-a0c8-9906a9e5449b]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:58 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD Sep 28 12:31:58 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:58 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD" returned: 0 in 0.320s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:58 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD Sep 28 12:31:58 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:59 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD" returned: 1 in 0.321s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Temporary image e341e1af-1141-4121-b8a2-ceb8bd1fb3ee is fetched for user 8b999ae431d24f33b0c111efe3a7b11c. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24a7eb5-5cdc-457e-b334-2b9fa982529f]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:59 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD Sep 28 12:31:59 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:59 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:59 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD Sep 28 12:31:59 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:31:59 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04edc1a-93b5-421f-9394-8e8261396798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204cd17415514350a456633dec66efc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:31:58Z,use_quota=True,user_id='8b999ae431d24f33b0c111efe3a7b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Creating volume e04edc1a-93b5-421f-9394-8e8261396798 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:31:59 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:31:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:31:59 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 1073741824 Sep 28 12:31:59 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:00 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 1073741824" returned: 0 in 0.394s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:00 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 Sep 28 12:32:00 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:00 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798" returned: 0 in 0.237s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Attempting download of e341e1af-1141-4121-b8a2-ceb8bd1fb3ee ((None, [{'url': 'file:///opt/stack/data/glance/images/e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'metadata': {}}])) to volume e04edc1a-93b5-421f-9394-8e8261396798. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aa9393-760f-4c24-b68f-322fb3623a6e]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_es009w9u {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:00 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_es009w9u Sep 28 12:32:00 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:00 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_es009w9u" returned: 0 in 0.325s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_es009w9u {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:01 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_es009w9u Sep 28 12:32:01 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:01 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_es009w9u" returned: 1 in 0.322s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_es009w9u' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7176fe3c-90c7-40d3-bc26-733c2bc6bfbe]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:01 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD Sep 28 12:32:01 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:01 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD" returned: 0 in 0.315s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:01 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD Sep 28 12:32:01 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:01 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD" returned: 1 in 0.313s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] e341e1af-1141-4121-b8a2-ceb8bd1fb3ee was raw, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:32:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:01 devstack sudo[105608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 Sep 28 12:32:01 devstack sudo[105608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:02 devstack sudo[105608]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798" returned: 0 in 0.434s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e341e1af-1141-4121-b8a2-ceb8bd1fb3ee_xve24v7vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:32:02 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:02 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 1G Sep 28 12:32:02 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:02 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 1G" returned: 0 in 0.300s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Downloaded image e341e1af-1141-4121-b8a2-ceb8bd1fb3ee ((None, [{'url': 'file:///opt/stack/data/glance/images/e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'metadata': {}}])) to volume e04edc1a-93b5-421f-9394-8e8261396798 successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Temporary image e341e1af-1141-4121-b8a2-ceb8bd1fb3ee for user 8b999ae431d24f33b0c111efe3a7b11c is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Marking volume e04edc1a-93b5-421f-9394-8e8261396798 as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Copying metadata from image e341e1af-1141-4121-b8a2-ceb8bd1fb3ee to e04edc1a-93b5-421f-9394-8e8261396798. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Creating volume glance metadata for volume e04edc1a-93b5-421f-9394-8e8261396798 backed by image e341e1af-1141-4121-b8a2-ceb8bd1fb3ee with: {'image_id': 'e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'd04cbc969a22ade28eec54ac905c0292', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7ab1ea9-fd9f-4fb0-988c-ee3af21a5253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04edc1a-93b5-421f-9394-8e8261396798', 'volume_size': 1, 'image_id': 'e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd04cbc969a22ade28eec54ac905c0292', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '204cd17415514350a456633dec66efc0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f8d9bbb1cb54790d306bb6c1e44ec02fdbcb0178b76694214b10733447ae879286da059c320867771191eac2018771e0a3a708b5f167859bb49186becb96cbb7', 'id': 'e341e1af-1141-4121-b8a2-ceb8bd1fb3ee', 'created_at': datetime.datetime(2026, 9, 28, 10, 31, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 31, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e341e1af-1141-4121-b8a2-ceb8bd1fb3ee/file', 'properties': {}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725285f8-8b2d-4c23-8c2d-f7f7d6175d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:02 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Volume volume-e04edc1a-93b5-421f-9394-8e8261396798 (e04edc1a-93b5-421f-9394-8e8261396798): created successfully Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725285f8-8b2d-4c23-8c2d-f7f7d6175d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Flow 'volume_create_manager' (3f728096-757a-4276-934f-ef629d24321f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:02 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-485be904-7ef3-44cd-a98b-b545f224ccd6 tempest-VolumeImageDependencyTests-832467923 None] Created volume successfully. Sep 28 12:32:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Acquiring lock "cinder-e04edc1a-93b5-421f-9394-8e8261396798-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Lock "cinder-e04edc1a-93b5-421f-9394-8e8261396798-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Acquiring lock "cinder-quobyte-e04edc1a-93b5-421f-9394-8e8261396798" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Lock "cinder-quobyte-e04edc1a-93b5-421f-9394-8e8261396798" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:03 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[094cdd46-277d-4d64-a5af-7a2f7e40d602]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:03 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 Sep 28 12:32:03 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:03 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798" returned: 0 in 0.348s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:03 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798 Sep 28 12:32:03 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:04 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e04edc1a-93b5-421f-9394-8e8261396798" returned: 0 in 0.231s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Lock "cinder-quobyte-e04edc1a-93b5-421f-9394-8e8261396798" released by "delete_volume" :: held 0.618s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Created reservations ['8916d0a4-2d2f-4c57-8597-8797d9859fc0', '04baa325-464e-47db-a4b8-a8ec30a199e7', '976146ad-6369-457a-9417-eec06dbee5c5', '147671a3-ed2b-476b-9fde-dfecdb07f3ec'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:04 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:04 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:04 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.254s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Deleted volume successfully. Sep 28 12:32:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7006d31b-b9bf-458a-b99d-4239554cd79f tempest-VolumeImageDependencyTests-832467923 None] Lock "cinder-e04edc1a-93b5-421f-9394-8e8261396798-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Flow 'volume_create_manager' (4513890d-0d76-4882-81d3-dc4104b66906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346f1edf-8f56-48c3-8e5c-c2891b5318a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346f1edf-8f56-48c3-8e5c-c2891b5318a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480615058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07143851-10c1-4efd-80d6-c6c2e1e8dfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bd81df49049af8c61ccd0515f179d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:12Z,use_quota=True,user_id='ef638d70e4374016876827ce0bbed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c01f60-4cbe-48ac-a255-cd5d2782dd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c01f60-4cbe-48ac-a255-cd5d2782dd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7096632c-0ee2-4636-8f20-e309d7ca0871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7096632c-0ee2-4636-8f20-e309d7ca0871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07143851-10c1-4efd-80d6-c6c2e1e8dfcf', 'volume_name': 'volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1826bd58-666e-4cd7-960f-600e6bef5509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1826bd58-666e-4cd7-960f-600e6bef5509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12acfc59-3fbb-45de-af67-8fab19121407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:11 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Volume 07143851-10c1-4efd-80d6-c6c2e1e8dfcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf', 'volume_size': 1} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-480615058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07143851-10c1-4efd-80d6-c6c2e1e8dfcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bd81df49049af8c61ccd0515f179d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:12Z,use_quota=True,user_id='ef638d70e4374016876827ce0bbed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Creating volume 07143851-10c1-4efd-80d6-c6c2e1e8dfcf {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:11 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:11 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf 1073741824 Sep 28 12:32:11 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:12 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf 1073741824" returned: 0 in 0.407s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:12 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf Sep 28 12:32:12 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:12 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf" returned: 0 in 0.232s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] <== create_volume: return (679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.682s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12acfc59-3fbb-45de-af67-8fab19121407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4403a1-a864-4078-a75f-383506cc359a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:12 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Volume volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf (07143851-10c1-4efd-80d6-c6c2e1e8dfcf): created successfully Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc4403a1-a864-4078-a75f-383506cc359a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Flow 'volume_create_manager' (4513890d-0d76-4882-81d3-dc4104b66906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-81ef7cca-0992-4ad6-8946-f26aec95262d tempest-ProjectReaderTests-714088783 None] Created volume successfully. Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Acquiring lock "cinder-07143851-10c1-4efd-80d6-c6c2e1e8dfcf-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Lock "cinder-07143851-10c1-4efd-80d6-c6c2e1e8dfcf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Acquiring lock "cinder-quobyte-07143851-10c1-4efd-80d6-c6c2e1e8dfcf" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Lock "cinder-quobyte-07143851-10c1-4efd-80d6-c6c2e1e8dfcf" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f79131-160b-4ce7-ac13-a4dbcdb3bc76]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:12 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf Sep 28 12:32:12 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:13 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf" returned: 0 in 0.345s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:13 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf Sep 28 12:32:13 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:13 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-07143851-10c1-4efd-80d6-c6c2e1e8dfcf" returned: 0 in 0.232s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Lock "cinder-quobyte-07143851-10c1-4efd-80d6-c6c2e1e8dfcf" released by "delete_volume" :: held 0.616s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Created reservations ['5a50374e-a77e-4074-900f-43fa48556094', 'c2e50301-acef-4c71-8753-60fd675bb8c4', '08457392-a038-478f-b2f9-a61e94d9e406', '8666980e-930b-48ef-a671-e3e4c2c9ec9a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:13 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:13 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:13 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.234s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Deleted volume successfully. Sep 28 12:32:13 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a7938675-3b9b-402c-8e15-cc1d9c28c228 tempest-ProjectReaderTests-714088783 None] Lock "cinder-07143851-10c1-4efd-80d6-c6c2e1e8dfcf-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Flow 'volume_create_manager' (3f12ae71-0dc8-42e6-9e3f-aa6bec748af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff22d83-9aa4-4d8c-a6a5-a96e28728357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff22d83-9aa4-4d8c-a6a5-a96e28728357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522906088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9d8bea-decb-41ba-8f6d-3600f2d90cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bd81df49049af8c61ccd0515f179d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:14Z,use_quota=True,user_id='ef638d70e4374016876827ce0bbed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556315c2-4526-4ba2-b545-6911f0e62e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (556315c2-4526-4ba2-b545-6911f0e62e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3bab03-f775-49cb-b69b-e820eefa524b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea3bab03-f775-49cb-b69b-e820eefa524b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f9d8bea-decb-41ba-8f6d-3600f2d90cc9', 'volume_name': 'volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137ceea1-9681-4574-a58e-7e8524fed84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137ceea1-9681-4574-a58e-7e8524fed84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3468bef8-81ab-497b-bd09-4ede9b4c219a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:14 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Volume 0f9d8bea-decb-41ba-8f6d-3600f2d90cc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9', 'volume_size': 1} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522906088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f9d8bea-decb-41ba-8f6d-3600f2d90cc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bd81df49049af8c61ccd0515f179d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:14Z,use_quota=True,user_id='ef638d70e4374016876827ce0bbed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Creating volume 0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:14 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:14 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 1073741824 Sep 28 12:32:14 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:14 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 1073741824" returned: 0 in 0.410s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:14 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 Sep 28 12:32:14 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:15 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9" returned: 0 in 0.238s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3468bef8-81ab-497b-bd09-4ede9b4c219a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63095ac6-0cec-4c48-9977-0db9c5979a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:15 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Volume volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 (0f9d8bea-decb-41ba-8f6d-3600f2d90cc9): created successfully Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63095ac6-0cec-4c48-9977-0db9c5979a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Flow 'volume_create_manager' (3f12ae71-0dc8-42e6-9e3f-aa6bec748af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0ea57fdd-9d3f-4eeb-b314-1311e2e571b0 tempest-ProjectReaderTests-714088783 None] Created volume successfully. Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Acquiring lock "cinder-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Lock "cinder-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Acquiring lock "cinder-quobyte-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Lock "cinder-quobyte-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9" acquired by "delete_volume" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3be1ec2-12c3-403f-b4bd-e3c8473810bd]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:15 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 Sep 28 12:32:15 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:15 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9" returned: 0 in 0.342s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:15 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9 Sep 28 12:32:15 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:16 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9" returned: 0 in 0.238s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Lock "cinder-quobyte-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9" released by "delete_volume" :: held 0.616s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Created reservations ['6681bc4f-1c1d-4ece-a3eb-cab4dae00dfb', '77637b9c-7450-4a1a-936a-101d5d4ea561', '6c201ba1-588a-4516-92f0-3f9a317c0505', 'ba77b1fb-e3ea-4fae-a0dd-b5e2cfc10a5f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:16 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:16 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:16 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.229s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Deleted volume successfully. Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-11666a5e-74d7-49c6-8d28-8dc16b4dd1ec tempest-ProjectReaderTests-714088783 None] Lock "cinder-0f9d8bea-decb-41ba-8f6d-3600f2d90cc9-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Flow 'volume_create_manager' (222c3832-f9d4-42d3-bcf0-a498d445046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d719b47-608a-4de6-9d61-424fcd8ad6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d719b47-608a-4de6-9d61-424fcd8ad6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963763607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0da5052-83f8-413a-9acf-bb7d245cfdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bd81df49049af8c61ccd0515f179d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:17Z,use_quota=True,user_id='ef638d70e4374016876827ce0bbed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb86aeab-b3d8-4bde-b578-e3a08f1db003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb86aeab-b3d8-4bde-b578-e3a08f1db003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8a6e6a-1364-4cb6-b023-df759a56e502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e8a6e6a-1364-4cb6-b023-df759a56e502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0da5052-83f8-413a-9acf-bb7d245cfdc9', 'volume_name': 'volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f2302b-c931-4c03-8dbb-ab1473606a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7f2302b-c931-4c03-8dbb-ab1473606a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62afd4ab-743d-4c99-a494-88ccbe562940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:17 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Volume b0da5052-83f8-413a-9acf-bb7d245cfdc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9', 'volume_size': 1} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1963763607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0da5052-83f8-413a-9acf-bb7d245cfdc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bd81df49049af8c61ccd0515f179d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:17Z,use_quota=True,user_id='ef638d70e4374016876827ce0bbed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Creating volume b0da5052-83f8-413a-9acf-bb7d245cfdc9 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:17 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:17 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 1073741824 Sep 28 12:32:17 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:17 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 1073741824" returned: 0 in 0.429s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:17 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 Sep 28 12:32:17 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:17 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62afd4ab-743d-4c99-a494-88ccbe562940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365bb592-1eed-47b9-895d-4073041c4fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:17 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Volume volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 (b0da5052-83f8-413a-9acf-bb7d245cfdc9): created successfully Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365bb592-1eed-47b9-895d-4073041c4fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:17 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Flow 'volume_create_manager' (222c3832-f9d4-42d3-bcf0-a498d445046d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e29bb28e-ea54-4f24-b244-142aaa75ee4b tempest-ProjectReaderTests-714088783 None] Created volume successfully. Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Acquiring lock "cinder-b0da5052-83f8-413a-9acf-bb7d245cfdc9-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Lock "cinder-b0da5052-83f8-413a-9acf-bb7d245cfdc9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Acquiring lock "cinder-quobyte-b0da5052-83f8-413a-9acf-bb7d245cfdc9" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Lock "cinder-quobyte-b0da5052-83f8-413a-9acf-bb7d245cfdc9" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b92fb32-9f5c-48ef-a5db-9636d3f6f1fc]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:18 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 Sep 28 12:32:18 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:18 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9" returned: 0 in 0.355s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:18 devstack sudo[105726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9 Sep 28 12:32:18 devstack sudo[105726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:18 devstack sudo[105726]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b0da5052-83f8-413a-9acf-bb7d245cfdc9" returned: 0 in 0.246s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Lock "cinder-quobyte-b0da5052-83f8-413a-9acf-bb7d245cfdc9" released by "delete_volume" :: held 0.641s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Created reservations ['469abbb5-11d4-4c55-889a-86446b1da17d', 'e9e97d3a-adbc-4ca2-a614-4802a90e7bbb', '072c1c5c-e8d6-40af-84e4-e1ce527ce3b5', 'e710b4a8-3dfa-42c1-b787-4a169e936446'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:18 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:18 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:19 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.241s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:19 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Deleted volume successfully. Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-9cc69ac2-98fb-4e7d-a54b-c93a8232b7b1 tempest-ProjectReaderTests-714088783 None] Lock "cinder-b0da5052-83f8-413a-9acf-bb7d245cfdc9-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Flow 'volume_create_manager' (05c55397-0002-4118-99b7-65bd310c9e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb64067f-4f3f-4c68-9d89-2f5b11d22239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb64067f-4f3f-4c68-9d89-2f5b11d22239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503796038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a135c501-fda9-492b-afbe-f7fa9883a828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bd81df49049af8c61ccd0515f179d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:20Z,use_quota=True,user_id='ef638d70e4374016876827ce0bbed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9752618-66e5-4152-9ead-0a1deea060ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9752618-66e5-4152-9ead-0a1deea060ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1515e785-5bc1-4370-bf83-3d4de047c3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1515e785-5bc1-4370-bf83-3d4de047c3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a135c501-fda9-492b-afbe-f7fa9883a828', 'volume_name': 'volume-a135c501-fda9-492b-afbe-f7fa9883a828', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245edfe5-5499-4d19-8a27-8a8659e95c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (245edfe5-5499-4d19-8a27-8a8659e95c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc5526b-25eb-4c64-b3e5-16ea8d89ee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:19 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Volume a135c501-fda9-492b-afbe-f7fa9883a828: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a135c501-fda9-492b-afbe-f7fa9883a828', 'volume_size': 1} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-503796038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a135c501-fda9-492b-afbe-f7fa9883a828,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bd81df49049af8c61ccd0515f179d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:20Z,use_quota=True,user_id='ef638d70e4374016876827ce0bbed819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Creating volume a135c501-fda9-492b-afbe-f7fa9883a828 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:19 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:19 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828 1073741824 Sep 28 12:32:19 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:20 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828 1073741824" returned: 0 in 0.396s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:20 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828 Sep 28 12:32:20 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:20 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828" returned: 0 in 0.248s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc5526b-25eb-4c64-b3e5-16ea8d89ee85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a135c501-fda9-492b-afbe-f7fa9883a828', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbff9504-a812-4e46-814b-34ac5032f3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:20 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Volume volume-a135c501-fda9-492b-afbe-f7fa9883a828 (a135c501-fda9-492b-afbe-f7fa9883a828): created successfully Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbff9504-a812-4e46-814b-34ac5032f3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Flow 'volume_create_manager' (05c55397-0002-4118-99b7-65bd310c9e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:20 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-24cbdf1b-86ef-4097-9ede-14bce3e1ff34 tempest-ProjectReaderTests-714088783 None] Created volume successfully. Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Acquiring lock "cinder-a135c501-fda9-492b-afbe-f7fa9883a828-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Lock "cinder-a135c501-fda9-492b-afbe-f7fa9883a828-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Acquiring lock "cinder-quobyte-a135c501-fda9-492b-afbe-f7fa9883a828" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Lock "cinder-quobyte-a135c501-fda9-492b-afbe-f7fa9883a828" acquired by "delete_volume" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd734d17-3f8e-4ee3-ae62-04ddaf96c6af]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:20 devstack sudo[105741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828 Sep 28 12:32:20 devstack sudo[105741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:21 devstack sudo[105741]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828" returned: 0 in 0.346s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:21 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828 Sep 28 12:32:21 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:21 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a135c501-fda9-492b-afbe-f7fa9883a828" returned: 0 in 0.238s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Lock "cinder-quobyte-a135c501-fda9-492b-afbe-f7fa9883a828" released by "delete_volume" :: held 0.626s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Created reservations ['714e3536-016b-4fdb-b383-8d5d1905e590', '2d0dbdd2-15f3-4a04-a207-7ed205f69115', '9f4773d9-a409-494c-851e-5285cc995ca1', 'a4fb34bd-4d62-4e79-9839-5a37031a4277'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:21 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:21 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:21 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.238s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:21 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Deleted volume successfully. Sep 28 12:32:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8dcd44a9-f07b-4939-b5fe-f0624c7d40d3 tempest-ProjectReaderTests-714088783 None] Lock "cinder-a135c501-fda9-492b-afbe-f7fa9883a828-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:31 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:INSERT=25,cinder:UPDATE=84,cinder:SELECT=58,cinder:DELETE=5 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:32:31 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=59,cinder:INSERT=25,cinder:UPDATE=92,cinder:DELETE=9 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (bdfddcdd-5916-4df7-bdf5-106cce6fe968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db37bf4-fa1e-486c-b5f5-095c7f8d37a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db37bf4-fa1e-486c-b5f5-095c7f8d37a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882040262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9382b261-cdd3-4263-a749-5e40fb1b749a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:34Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caa7c1c-28e9-44cb-838e-d2f3b557db6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9caa7c1c-28e9-44cb-838e-d2f3b557db6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de88c90e-5853-4c18-9f2e-4ae8724721e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de88c90e-5853-4c18-9f2e-4ae8724721e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9382b261-cdd3-4263-a749-5e40fb1b749a', 'volume_name': 'volume-9382b261-cdd3-4263-a749-5e40fb1b749a', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b6fdf7-9317-42c0-9c73-070a87e81018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b6fdf7-9317-42c0-9c73-070a87e81018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8aad66-ee59-4b2a-b0e8-58b96e0eaf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Volume 9382b261-cdd3-4263-a749-5e40fb1b749a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9382b261-cdd3-4263-a749-5e40fb1b749a', 'volume_size': 1} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1882040262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9382b261-cdd3-4263-a749-5e40fb1b749a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:34Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Creating volume 9382b261-cdd3-4263-a749-5e40fb1b749a {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:34 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:34 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a 1073741824 Sep 28 12:32:34 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Flow 'volume_create_manager' (72575fec-cb6f-44f3-bd01-b2ae79a293e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6689f17d-d0c2-44f4-9bff-1423e492d512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (76f6257e-42ba-4cfa-8eb7-9d718070b93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca05726-5333-4727-8b01-c50a996bd8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ca05726-5333-4727-8b01-c50a996bd8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270472720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee74439-4b61-4187-8b48-7bec20ff5f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:34Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088c821d-7c13-443b-bd63-f610d634a751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (088c821d-7c13-443b-bd63-f610d634a751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2305b68c-d5aa-440c-a74a-90820406f06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2305b68c-d5aa-440c-a74a-90820406f06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ee74439-4b61-4187-8b48-7bec20ff5f19', 'volume_name': 'volume-9ee74439-4b61-4187-8b48-7bec20ff5f19', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b722be-004c-4377-ae5d-4c501aa47ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26b722be-004c-4377-ae5d-4c501aa47ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a154ac-e924-4129-badd-7db3206936e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Volume 9ee74439-4b61-4187-8b48-7bec20ff5f19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ee74439-4b61-4187-8b48-7bec20ff5f19', 'volume_size': 1} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6689f17d-d0c2-44f4-9bff-1423e492d512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1353543716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db07c61630d7448d8353ffdbc79a3b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:34Z,use_quota=True,user_id='3551dec983334982a4df775522a1514f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047c8fd0-a61a-4ce5-be43-3a539a14f0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (047c8fd0-a61a-4ce5-be43-3a539a14f0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a653cd41-d47f-449e-a131-43e877402276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a653cd41-d47f-449e-a131-43e877402276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5', 'volume_name': 'volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb464f89-4e9d-4101-ab8b-db1063890987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb464f89-4e9d-4101-ab8b-db1063890987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e5aefa-abef-4617-bf2a-cbb4efb7b203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:34 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Volume e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5', 'volume_size': 1} Sep 28 12:32:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (823d2162-0d96-4959-aec1-4b2575870a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb846dc-440b-4ae6-9bb9-0bdbf5a31071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfb846dc-440b-4ae6-9bb9-0bdbf5a31071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053613084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ff068-7a07-4211-9f49-70bea9ef8857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:35Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe2216c-8526-49da-a141-3d3da3dc0248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfe2216c-8526-49da-a141-3d3da3dc0248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1beb61f-c7c9-4f9d-8839-614712eac8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1beb61f-c7c9-4f9d-8839-614712eac8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '287ff068-7a07-4211-9f49-70bea9ef8857', 'volume_name': 'volume-287ff068-7a07-4211-9f49-70bea9ef8857', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c02ed7-23cc-4dc6-9b3f-6c3eb24632d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94c02ed7-23cc-4dc6-9b3f-6c3eb24632d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb09cff-5191-4dbc-be02-258aba138f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume 287ff068-7a07-4211-9f49-70bea9ef8857: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-287ff068-7a07-4211-9f49-70bea9ef8857', 'volume_size': 1} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:35 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (76721b4f-d27a-4887-9e0f-855200ecc459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e717fb9-eae4-480c-82cd-86648da7d2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a 1073741824" returned: 0 in 0.849s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e717fb9-eae4-480c-82cd-86648da7d2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-390274929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3304d34d-8959-42cd-a9df-8b40ad588057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:35Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb7898d-28ec-40a8-ab78-49611077df6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb7898d-28ec-40a8-ab78-49611077df6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e028fbcf-742b-4200-aadb-f018cd8ff5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e028fbcf-742b-4200-aadb-f018cd8ff5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3304d34d-8959-42cd-a9df-8b40ad588057', 'volume_name': 'volume-3304d34d-8959-42cd-a9df-8b40ad588057', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca798195-adf5-4237-9857-d54886a9ee06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca798195-adf5-4237-9857-d54886a9ee06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2e1ee-0f90-48b7-ab3c-e26adac0161e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Volume 3304d34d-8959-42cd-a9df-8b40ad588057: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3304d34d-8959-42cd-a9df-8b40ad588057', 'volume_size': 1} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:35 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a Sep 28 12:32:35 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (f4767042-3334-4d85-9a85-a72ab72e8f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38004d66-f728-4620-9bc0-d1df98d5b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38004d66-f728-4620-9bc0-d1df98d5b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-726564108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f269f1c-8b30-4bbf-85cb-d4c591f4e920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:36Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22f0e46-63a1-430f-a413-fa73a0319115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e22f0e46-63a1-430f-a413-fa73a0319115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd2fc0b-2dfc-4cb0-9485-d01f6700a870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd2fc0b-2dfc-4cb0-9485-d01f6700a870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f269f1c-8b30-4bbf-85cb-d4c591f4e920', 'volume_name': 'volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110b004e-7aff-404c-b300-ace2a2960c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110b004e-7aff-404c-b300-ace2a2960c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3325960b-c786-4483-b045-56b099ae0ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Volume 2f269f1c-8b30-4bbf-85cb-d4c591f4e920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920', 'volume_size': 1} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:35 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a" returned: 0 in 0.299s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.021s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1270472720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ee74439-4b61-4187-8b48-7bec20ff5f19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:34Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Creating volume 9ee74439-4b61-4187-8b48-7bec20ff5f19 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:35 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8aad66-ee59-4b2a-b0e8-58b96e0eaf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9382b261-cdd3-4263-a749-5e40fb1b749a', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 1073741824 Sep 28 12:32:35 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d186f85-7583-470c-a8ae-9615e233860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:35 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Volume volume-9382b261-cdd3-4263-a749-5e40fb1b749a (9382b261-cdd3-4263-a749-5e40fb1b749a): created successfully Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d186f85-7583-470c-a8ae-9615e233860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:35 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (bdfddcdd-5916-4df7-bdf5-106cce6fe968) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:35 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d790a97b-c604-4f02-ab16-87d02bc74ea0 tempest-CreateVolumesFromImageTest-460262223 None] Created volume successfully. Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (9bda2257-11d1-4422-b34e-76a4166b41ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1197edf-d2eb-406a-8b3a-b5dcb4a30b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1197edf-d2eb-406a-8b3a-b5dcb4a30b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149597083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e544686-320a-4d3f-9918-943f4c8f36dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:36Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749e7483-21c5-4186-ba33-924fbf416300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (749e7483-21c5-4186-ba33-924fbf416300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5957f412-addf-4eb1-8862-137302523014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5957f412-addf-4eb1-8862-137302523014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e544686-320a-4d3f-9918-943f4c8f36dc', 'volume_name': 'volume-1e544686-320a-4d3f-9918-943f4c8f36dc', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f747f636-8a73-4233-9308-de1ab0092cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f747f636-8a73-4233-9308-de1ab0092cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aa3e00-a4ef-4350-8b59-8acebd5fbcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:36 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Volume 1e544686-320a-4d3f-9918-943f4c8f36dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e544686-320a-4d3f-9918-943f4c8f36dc', 'volume_size': 1} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:36 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 1073741824" returned: 0 in 0.559s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:36 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 Sep 28 12:32:36 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:36 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19" returned: 0 in 0.248s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.834s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1353543716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db07c61630d7448d8353ffdbc79a3b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:34Z,use_quota=True,user_id='3551dec983334982a4df775522a1514f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Creating volume e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:36 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:36 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 1073741824 Sep 28 12:32:36 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9a154ac-e924-4129-badd-7db3206936e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ee74439-4b61-4187-8b48-7bec20ff5f19', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ebf604-db38-49e7-9013-3b1ab226181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:36 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Volume volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 (9ee74439-4b61-4187-8b48-7bec20ff5f19): created successfully Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ebf604-db38-49e7-9013-3b1ab226181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (76f6257e-42ba-4cfa-8eb7-9d718070b93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:36 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8e3d5851-ac2c-40b2-8584-93ee1753860d tempest-CreateVolumesFromImageTest-460262223 None] Created volume successfully. Sep 28 12:32:37 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 1073741824" returned: 0 in 0.457s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:37 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 Sep 28 12:32:37 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:37 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" returned: 0 in 0.263s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.220s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1053613084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=287ff068-7a07-4211-9f49-70bea9ef8857,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:35Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Creating volume 287ff068-7a07-4211-9f49-70bea9ef8857 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:37 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e5aefa-abef-4617-bf2a-cbb4efb7b203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d47cb6-be7f-45c8-9232-bc4cfd5d2f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:37 devstack sudo[105820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857 1073741824 Sep 28 12:32:37 devstack sudo[105820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:37 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Volume volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 (e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5): created successfully Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5d47cb6-be7f-45c8-9232-bc4cfd5d2f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Flow 'volume_create_manager' (72575fec-cb6f-44f3-bd01-b2ae79a293e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:37 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9b616123-90ef-42d5-baa8-ef9bbf434209 tempest-VolumeDependencyTests-1986263950 None] Created volume successfully. Sep 28 12:32:37 devstack sudo[105820]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857 1073741824" returned: 0 in 0.481s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:37 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857 Sep 28 12:32:37 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Flow 'volume_create_manager' (d7412461-1149-4573-b25e-bf2c4e82f0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920da1a1-150d-4d17-bb56-d5d6a0990c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:38 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:38 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920da1a1-150d-4d17-bb56-d5d6a0990c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c9fb8a-3265-4109-8f5f-3916fa4a5a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271acfc01b964d3a83df3d6ea91db743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:38Z,use_quota=True,user_id='cf8a68cfd48f40478ddfdf71e84bcc5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f149f98d-e63a-4910-abed-ab94759e0f1d),volume_type_id=f149f98d-e63a-4910-abed-ab94759e0f1d)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af194eb-90ff-4c2c-8151-d223741b1d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af194eb-90ff-4c2c-8151-d223741b1d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e581efe-d849-476d-80e7-bad146c3345e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:32:38 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857" returned: 0 in 0.287s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.794s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-390274929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3304d34d-8959-42cd-a9df-8b40ad588057,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:35Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Creating volume 3304d34d-8959-42cd-a9df-8b40ad588057 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:38 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb09cff-5191-4dbc-be02-258aba138f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-287ff068-7a07-4211-9f49-70bea9ef8857', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:38 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057 1073741824 Sep 28 12:32:38 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7eba630-8ff2-4fb6-8eed-6325166e22ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:38 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume volume-287ff068-7a07-4211-9f49-70bea9ef8857 (287ff068-7a07-4211-9f49-70bea9ef8857): created successfully Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7eba630-8ff2-4fb6-8eed-6325166e22ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (823d2162-0d96-4959-aec1-4b2575870a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-78bfe690-842f-4915-b314-91b0a4689bde tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created volume successfully. Sep 28 12:32:38 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.329s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e581efe-d849-476d-80e7-bad146c3345e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '78c9fb8a-3265-4109-8f5f-3916fa4a5a14', 'volume_name': 'volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14', 'volume_size': 1, 'image_id': '9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d68e85b86422ceb0b031f79e1274ee7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '271acfc01b964d3a83df3d6ea91db743', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd71bef88b17fd948ab7588d029c7a4f6f066ca5eb34a0391bde6c20ad2b4053335ade7f8f5e7857430b2f16f3eb0ceb8c3b87e6be18cf872aaae63aaf93002d8', 'id': '9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'created_at': datetime.datetime(2026, 9, 28, 10, 32, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 32, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c868ae9-a14e-4718-8f7e-5177ea3a30d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0d6f7f-6fa3-4b90-9fb1-9a8437b37ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c0d6f7f-6fa3-4b90-9fb1-9a8437b37ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df077c99-a5ab-4dc4-8aae-0932e826e458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:38 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Volume 78c9fb8a-3265-4109-8f5f-3916fa4a5a14: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14', 'volume_size': 1, 'image_id': '9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d68e85b86422ceb0b031f79e1274ee7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '271acfc01b964d3a83df3d6ea91db743', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd71bef88b17fd948ab7588d029c7a4f6f066ca5eb34a0391bde6c20ad2b4053335ade7f8f5e7857430b2f16f3eb0ceb8c3b87e6be18cf872aaae63aaf93002d8', 'id': '9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'created_at': datetime.datetime(2026, 9, 28, 10, 32, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 32, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c868ae9-a14e-4718-8f7e-5177ea3a30d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Trying to clone 78c9fb8a-3265-4109-8f5f-3916fa4a5a14 from image 9c868ae9-a14e-4718-8f7e-5177ea3a30d2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:32:38 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7a22c1-31bd-49e3-a657-9b8271995ac1]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:38 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057 1073741824" returned: 0 in 0.580s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:38 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057 Sep 28 12:32:38 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:38 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD Sep 28 12:32:38 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (629f99c2-0f35-4749-9dd5-a833bae422cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:39 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39f5905-146d-4527-b658-7eae93e29638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057" returned: 0 in 0.300s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.455s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-726564108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f269f1c-8b30-4bbf-85cb-d4c591f4e920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:36Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Creating volume 2f269f1c-8b30-4bbf-85cb-d4c591f4e920 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:39 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:39 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:39 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 1073741824 Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39f5905-146d-4527-b658-7eae93e29638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444895462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d83f211-1e4e-456e-bc5c-29f07198a38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:39Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55f6066-d1b5-4a50-a09a-26c4ac1eb37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f55f6066-d1b5-4a50-a09a-26c4ac1eb37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10e5b7e-a4b4-4693-82de-bc4f3879e3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10e5b7e-a4b4-4693-82de-bc4f3879e3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d83f211-1e4e-456e-bc5c-29f07198a38e', 'volume_name': 'volume-5d83f211-1e4e-456e-bc5c-29f07198a38e', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e8b20e-5d8c-4280-83d2-8268b016ad78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0e8b20e-5d8c-4280-83d2-8268b016ad78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c998bed-729e-4340-9e40-c03c1c02b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume 5d83f211-1e4e-456e-bc5c-29f07198a38e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d83f211-1e4e-456e-bc5c-29f07198a38e', 'volume_size': 1} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD" returned: 0 in 0.501s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2e1ee-0f90-48b7-ab3c-e26adac0161e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3304d34d-8959-42cd-a9df-8b40ad588057', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c467057-4831-4294-ac52-2299938348d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Volume volume-3304d34d-8959-42cd-a9df-8b40ad588057 (3304d34d-8959-42cd-a9df-8b40ad588057): created successfully Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c467057-4831-4294-ac52-2299938348d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (76721b4f-d27a-4887-9e0f-855200ecc459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:39 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-67552f9d-c6f3-4735-9c38-ddc068fdc427 tempest-CreateVolumesFromImageTest-460262223 None] Created volume successfully. Sep 28 12:32:39 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD Sep 28 12:32:39 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (62fc20a1-8208-48ed-876e-b396b35ca267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c4cf33-2142-4418-9a1e-8fa90318e692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c4cf33-2142-4418-9a1e-8fa90318e692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-899332966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfc3d1d-0832-4004-9f8d-83240a339e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:39Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5dd0c5-f935-4c36-b26f-b7385e6c197b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5dd0c5-f935-4c36-b26f-b7385e6c197b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8aa308-d48a-4cca-a0a2-6894155fe1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee8aa308-d48a-4cca-a0a2-6894155fe1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bfc3d1d-0832-4004-9f8d-83240a339e36', 'volume_name': 'volume-2bfc3d1d-0832-4004-9f8d-83240a339e36', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49e703d-20da-43a6-9dde-64f912467c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a49e703d-20da-43a6-9dde-64f912467c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194b5dc0-8536-4b31-ad35-ed854bd976e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:39 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume 2bfc3d1d-0832-4004-9f8d-83240a339e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bfc3d1d-0832-4004-9f8d-83240a339e36', 'volume_size': 1} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Temporary image 9c868ae9-a14e-4718-8f7e-5177ea3a30d2 is fetched for user cf8a68cfd48f40478ddfdf71e84bcc5a. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:32:39 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 1073741824" returned: 0 in 0.560s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a99f1-dd46-4ceb-868d-4c6e6dba1b45]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:39 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 Sep 28 12:32:39 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:39 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD Sep 28 12:32:39 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:39 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (ea93cb8d-56e8-4789-8735-c158f964b90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5baff3b1-61ec-44cd-a921-bad589972556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5baff3b1-61ec-44cd-a921-bad589972556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935618050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b39e87-d287-4ef6-a754-1fb83ce54a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:40Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391c5140-44d0-4a48-9fe4-9d4d02d2e903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391c5140-44d0-4a48-9fe4-9d4d02d2e903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b70ee1-ab10-4a6d-bb36-3d7fa6ce9a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3b70ee1-ab10-4a6d-bb36-3d7fa6ce9a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15b39e87-d287-4ef6-a754-1fb83ce54a68', 'volume_name': 'volume-15b39e87-d287-4ef6-a754-1fb83ce54a68', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151603f6-82b0-4967-89e2-787383bb5fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151603f6-82b0-4967-89e2-787383bb5fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607003c6-7660-49b1-a13f-1c72d000ade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume 15b39e87-d287-4ef6-a754-1fb83ce54a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15b39e87-d287-4ef6-a754-1fb83ce54a68', 'volume_size': 1} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:40 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920" returned: 0 in 0.327s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.975s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149597083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e544686-320a-4d3f-9918-943f4c8f36dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b338e67fe69b44758cfb6ec07413d6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:36Z,use_quota=True,user_id='221c1c8ef7684174917ef426a37c035a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Creating volume 1e544686-320a-4d3f-9918-943f4c8f36dc {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:40 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3325960b-c786-4483-b045-56b099ae0ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc 1073741824 Sep 28 12:32:40 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f14498f-520a-4a4b-874b-8d1cfddb0562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Volume volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 (2f269f1c-8b30-4bbf-85cb-d4c591f4e920): created successfully Sep 28 12:32:40 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f14498f-520a-4a4b-874b-8d1cfddb0562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (f4767042-3334-4d85-9a85-a72ab72e8f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:40 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a25fe42e-08d9-4da3-b14a-a1e3dea7e38b tempest-CreateVolumesFromImageTest-460262223 None] Created volume successfully. Sep 28 12:32:40 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD Sep 28 12:32:40 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (6939de08-d929-4b02-a593-0e49279e239a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49623feb-1131-4877-9060-6b4ded521830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49623feb-1131-4877-9060-6b4ded521830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596283202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b13a1a3-7cfd-421c-bb2e-8549cc229306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:40Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f95d67b-3f4c-419a-8cf6-4021dae3d81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f95d67b-3f4c-419a-8cf6-4021dae3d81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30651cff-2cac-44ec-ae86-85e91a1e6a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30651cff-2cac-44ec-ae86-85e91a1e6a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b13a1a3-7cfd-421c-bb2e-8549cc229306', 'volume_name': 'volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce59406-96d5-4d97-95e3-80d2633c39d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce59406-96d5-4d97-95e3-80d2633c39d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc530ebd-6c7f-4ad7-a05c-5087c073ff45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:40 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume 3b13a1a3-7cfd-421c-bb2e-8549cc229306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306', 'volume_size': 1} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:40 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc 1073741824" returned: 0 in 0.547s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:40 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD" returned: 1 in 0.469s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:40 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc Sep 28 12:32:40 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (6e2f5586-e321-48f0-9eb6-9e835ec322a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb6d2fd-a993-4897-a603-50ed872acc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb6d2fd-a993-4897-a603-50ed872acc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-747749871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f9a325-67cb-4b7b-9460-99df6746e7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:41Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:41 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4166d65-efa7-4f10-9901-e9368105e02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4166d65-efa7-4f10-9901-e9368105e02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dd1ca3-59f4-45e1-95ab-74d01bc1ab16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00dd1ca3-59f4-45e1-95ab-74d01bc1ab16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10f9a325-67cb-4b7b-9460-99df6746e7cb', 'volume_name': 'volume-10f9a325-67cb-4b7b-9460-99df6746e7cb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c7f901-441e-4f91-ab2c-37c5a2bda84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6c7f901-441e-4f91-ab2c-37c5a2bda84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b76891c-ac01-487d-adc1-b170c26bf818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:41 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume 10f9a325-67cb-4b7b-9460-99df6746e7cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10f9a325-67cb-4b7b-9460-99df6746e7cb', 'volume_size': 1} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc" returned: 0 in 0.308s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.208s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aa3e00-a4ef-4350-8b59-8acebd5fbcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e544686-320a-4d3f-9918-943f4c8f36dc', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c92d2e-44ed-43b4-b716-c01452efdeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Creating offline snapshot f395529c-f798-4d13-a934-5fa6acb546c9 of volume e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:32:41 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Volume volume-1e544686-320a-4d3f-9918-943f4c8f36dc (1e544686-320a-4d3f-9918-943f4c8f36dc): created successfully Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c92d2e-44ed-43b4-b716-c01452efdeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Flow 'volume_create_manager' (9bda2257-11d1-4422-b34e-76a4166b41ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7da9d0-53f1-4b22-817b-20538e51c909]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:41 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5d058795-c0a4-4cc0-b0ab-5c3f94cf898c tempest-CreateVolumesFromImageTest-460262223 None] Created volume successfully. Sep 28 12:32:41 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 Sep 28 12:32:41 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:41 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" returned: 0 in 0.374s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:41 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 1G Sep 28 12:32:41 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-1e544686-320a-4d3f-9918-943f4c8f36dc-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-1e544686-320a-4d3f-9918-943f4c8f36dc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-quobyte-1e544686-320a-4d3f-9918-943f4c8f36dc" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-1e544686-320a-4d3f-9918-943f4c8f36dc" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc4d052-8b2f-4c2f-9598-2401a501c8ab]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:41 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc Sep 28 12:32:41 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:41 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 1G" returned: 0 in 0.466s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:41 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 Sep 28 12:32:41 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:42 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc" returned: 0 in 0.374s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:42 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc Sep 28 12:32:42 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:42 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9" returned: 0 in 0.295s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:42 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 is being set with open permissions: ugo+rw Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:42 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 Sep 28 12:32:42 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:42 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-1e544686-320a-4d3f-9918-943f4c8f36dc" returned: 0 in 0.274s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-1e544686-320a-4d3f-9918-943f4c8f36dc" released by "delete_volume" :: held 0.698s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:42 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9" returned: 0 in 0.294s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Created reservations ['e1c88c97-1e79-4777-8d0b-0f5b1fd9fe42', '0ef1c943-e94c-4c33-90db-c1cd6de7202b', '7da5472c-346d-46f2-8d10-1f6a61951136', 'f9c15ff4-c6d6-45bc-be19-a7c73fe29fd2'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:42 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.info Sep 28 12:32:42 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:42 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:42 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:42 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.info" returned: 0 in 0.274s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:42 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.info is being set with open permissions: ugo+rw Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-2f269f1c-8b30-4bbf-85cb-d4c591f4e920-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:42 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.info Sep 28 12:32:42 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-2f269f1c-8b30-4bbf-85cb-d4c591f4e920-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:42 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.290s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:42 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:42 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Deleted volume successfully. Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-quobyte-2f269f1c-8b30-4bbf-85cb-d4c591f4e920" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-04ce293c-60e6-4df0-a99e-9f8f6dc33789 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-1e544686-320a-4d3f-9918-943f4c8f36dc-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-2f269f1c-8b30-4bbf-85cb-d4c591f4e920" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba85e91-5583-4513-8bed-19a7660f0d98]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:43 devstack sudo[105912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 Sep 28 12:32:43 devstack sudo[105912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:43 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.info" returned: 0 in 0.331s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.961s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-444895462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d83f211-1e4e-456e-bc5c-29f07198a38e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:39Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Creating volume 5d83f211-1e4e-456e-bc5c-29f07198a38e {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:43 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:43 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e 1073741824 Sep 28 12:32:43 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d110be0f-bb96-44b2-aa92-b24e831fd6eb tempest-VolumeDependencyTests-1986263950 None] Create snapshot completed successfully Sep 28 12:32:43 devstack sudo[105912]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920" returned: 0 in 0.387s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:43 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920 Sep 28 12:32:43 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:43 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e 1073741824" returned: 0 in 0.424s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:43 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2f269f1c-8b30-4bbf-85cb-d4c591f4e920" returned: 0 in 0.272s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-2f269f1c-8b30-4bbf-85cb-d4c591f4e920" released by "delete_volume" :: held 0.699s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:43 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e Sep 28 12:32:43 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Created reservations ['94655c2b-b93d-4254-ab8c-33b4b1a6df2b', '7f7cc78a-66a0-4305-9bd5-ff4851ef790c', '408ffc90-b745-46d3-90d9-07ebf744bc3d', '7a72b8f9-8434-4a95-b269-413fc74840c7'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:43 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:43 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:43 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e" returned: 0 in 0.263s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.293s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-899332966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bfc3d1d-0832-4004-9f8d-83240a339e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:39Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Creating volume 2bfc3d1d-0832-4004-9f8d-83240a339e36 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:43 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:44 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 1073741824 Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c998bed-729e-4340-9e40-c03c1c02b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d83f211-1e4e-456e-bc5c-29f07198a38e', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:44 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ca9f90-7283-470e-9374-c44a98902964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:44 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume volume-5d83f211-1e4e-456e-bc5c-29f07198a38e (5d83f211-1e4e-456e-bc5c-29f07198a38e): created successfully Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23ca9f90-7283-470e-9374-c44a98902964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (629f99c2-0f35-4749-9dd5-a833bae422cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4f946f3a-4c8f-4755-a9e5-d6ba64db21db tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created volume successfully. Sep 28 12:32:44 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.300s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Deleted volume successfully. Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-020b4e53-9849-479e-88e3-531e9c1146e3 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-2f269f1c-8b30-4bbf-85cb-d4c591f4e920-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-3304d34d-8959-42cd-a9df-8b40ad588057-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-3304d34d-8959-42cd-a9df-8b40ad588057-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-quobyte-3304d34d-8959-42cd-a9df-8b40ad588057" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-3304d34d-8959-42cd-a9df-8b40ad588057" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd275a38-1751-4565-ad62-eb74f46da334]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:44 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057 Sep 28 12:32:44 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:44 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 1073741824" returned: 0 in 0.579s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:44 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 Sep 28 12:32:44 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Flow 'volume_create_manager' (5f3b9fb2-8423-4add-9448-94501aacc855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911afa0f-6950-44c9-ac0d-bec269b6966d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:44 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (911afa0f-6950-44c9-ac0d-bec269b6966d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1936563790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db07c61630d7448d8353ffdbc79a3b73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f395529c-f798-4d13-a934-5fa6acb546c9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:45Z,use_quota=True,user_id='3551dec983334982a4df775522a1514f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f096485-a8d6-423c-8153-1849454d68d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f096485-a8d6-423c-8153-1849454d68d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd15b707-cafb-47c9-9267-f7b12fb44b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd15b707-cafb-47c9-9267-f7b12fb44b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26', 'volume_name': 'volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26', 'volume_size': 1, 'snapshot_id': 'f395529c-f798-4d13-a934-5fa6acb546c9'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21662f0a-edd5-414c-bfd2-2af359ea33d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21662f0a-edd5-414c-bfd2-2af359ea33d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b113eaf8-a626-48cb-9b77-284d53cb5c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:44 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Volume 2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26', 'volume_size': 1, 'snapshot_id': 'f395529c-f798-4d13-a934-5fa6acb546c9'} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057" returned: 0 in 0.518s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:44 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36" returned: 0 in 0.269s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.755s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935618050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15b39e87-d287-4ef6-a754-1fb83ce54a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:40Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Creating volume 15b39e87-d287-4ef6-a754-1fb83ce54a68 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:44 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057 Sep 28 12:32:44 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:44 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194b5dc0-8536-4b31-ad35-ed854bd976e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bfc3d1d-0832-4004-9f8d-83240a339e36', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039e1dc9-6ae9-4d30-b4f7-b139997b415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:44 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 1073741824 Sep 28 12:32:44 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:44 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 (2bfc3d1d-0832-4004-9f8d-83240a339e36): created successfully Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (039e1dc9-6ae9-4d30-b4f7-b139997b415f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (62fc20a1-8208-48ed-876e-b396b35ca267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-167c128e-e9c5-47fa-9eb4-ba86009b2e16 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created volume successfully. Sep 28 12:32:45 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3304d34d-8959-42cd-a9df-8b40ad588057" returned: 0 in 0.259s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-3304d34d-8959-42cd-a9df-8b40ad588057" released by "delete_volume" :: held 0.835s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Created reservations ['de9d2748-8c7d-43de-ac9c-69dc7292b63c', '2a8472e4-030b-4122-9348-116af71c9abc', '5b74e854-5734-479a-a8bf-f724e336bfcf', '7e0751e6-b145-49fa-a998-286dc49e0f53'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:45 devstack sudo[105955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:45 devstack sudo[105955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-9ee74439-4b61-4187-8b48-7bec20ff5f19-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-9ee74439-4b61-4187-8b48-7bec20ff5f19-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-quobyte-9ee74439-4b61-4187-8b48-7bec20ff5f19" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:45 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-9ee74439-4b61-4187-8b48-7bec20ff5f19" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 1073741824" returned: 0 in 0.629s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feb83bf-d787-4b70-b480-e41f5191101c]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:45 devstack sudo[105955]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.291s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Deleted volume successfully. Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e5ccf7f4-3080-44cf-940a-209173dd6e72 tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-3304d34d-8959-42cd-a9df-8b40ad588057-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:45 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 Sep 28 12:32:45 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:45 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 Sep 28 12:32:45 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:45 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68" returned: 0 in 0.260s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.268s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1596283202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b13a1a3-7cfd-421c-bb2e-8549cc229306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:40Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Creating volume 3b13a1a3-7cfd-421c-bb2e-8549cc229306 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:45 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607003c6-7660-49b1-a13f-1c72d000ade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15b39e87-d287-4ef6-a754-1fb83ce54a68', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:45 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 1073741824 Sep 28 12:32:45 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f03c39-88a8-49c6-aab7-95cd4ccc312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:45 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 (15b39e87-d287-4ef6-a754-1fb83ce54a68): created successfully Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f03c39-88a8-49c6-aab7-95cd4ccc312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (ea93cb8d-56e8-4789-8735-c158f964b90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a7c21336-1814-415c-808d-75f2f74e960d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created volume successfully. Sep 28 12:32:45 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19" returned: 0 in 0.428s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:45 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19 Sep 28 12:32:45 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:46 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9ee74439-4b61-4187-8b48-7bec20ff5f19" returned: 0 in 0.271s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-9ee74439-4b61-4187-8b48-7bec20ff5f19" released by "delete_volume" :: held 0.752s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Created reservations ['6b0297b1-eaa8-403a-9cb7-d95fb1bdf147', 'f6fa63ce-7908-45de-856a-aa7e66abae9c', 'c6bb179e-187b-4836-a3b4-c99f5e81f28b', 'ba19ad30-7301-43f9-8d45-b41993f06b15'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:46 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 1073741824" returned: 0 in 0.453s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:46 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 Sep 28 12:32:46 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:46 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:46 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-9382b261-cdd3-4263-a749-5e40fb1b749a-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-9382b261-cdd3-4263-a749-5e40fb1b749a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "cinder-quobyte-9382b261-cdd3-4263-a749-5e40fb1b749a" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:46 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306" returned: 0 in 0.312s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.927s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78c9fb8a-3265-4109-8f5f-3916fa4a5a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='271acfc01b964d3a83df3d6ea91db743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:38Z,use_quota=True,user_id='cf8a68cfd48f40478ddfdf71e84bcc5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f149f98d-e63a-4910-abed-ab94759e0f1d),volume_type_id=f149f98d-e63a-4910-abed-ab94759e0f1d)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Creating volume 78c9fb8a-3265-4109-8f5f-3916fa4a5a14 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:46 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:46 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.309s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-9382b261-cdd3-4263-a749-5e40fb1b749a" acquired by "delete_volume" :: waited 0.053s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:46 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 1073741824 Sep 28 12:32:46 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Deleted volume successfully. Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc530ebd-6c7f-4ad7-a05c-5087c073ff45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e8acaf-b6e3-454e-9dc3-e6bdf533dc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b062b05-4adf-422d-a984-d0a8e45651a9]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:46 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 (3b13a1a3-7cfd-421c-bb2e-8549cc229306): created successfully Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e8acaf-b6e3-454e-9dc3-e6bdf533dc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (6939de08-d929-4b02-a593-0e49279e239a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-61d490c5-858b-4ffc-b2e6-1cab45ab3161 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created volume successfully. Sep 28 12:32:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-92f2971b-2518-40a8-9633-040138d6a5fe tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-9ee74439-4b61-4187-8b48-7bec20ff5f19-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:46 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a Sep 28 12:32:46 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:47 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a" returned: 0 in 0.376s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:47 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 1073741824" returned: 0 in 0.463s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:47 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a Sep 28 12:32:47 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:47 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 Sep 28 12:32:47 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:47 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9382b261-cdd3-4263-a749-5e40fb1b749a" returned: 0 in 0.270s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-quobyte-9382b261-cdd3-4263-a749-5e40fb1b749a" released by "delete_volume" :: held 0.716s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:47 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14" returned: 0 in 0.250s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.390s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:32:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-747749871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10f9a325-67cb-4b7b-9460-99df6746e7cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265d884592584542be62ba00e79859c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:32:41Z,use_quota=True,user_id='d185b65e64a4456cabb1bb8e50deb32b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Creating volume 10f9a325-67cb-4b7b-9460-99df6746e7cb {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:47 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:47 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb 1073741824 Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Attempting download of 9c868ae9-a14e-4718-8f7e-5177ea3a30d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'metadata': {}}])) to volume 78c9fb8a-3265-4109-8f5f-3916fa4a5a14. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:32:47 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Created reservations ['0cb93057-f7a8-4564-951b-c56cec7877ea', 'd8591ee7-ce2f-470a-a2aa-d31a665749c3', '0f816917-7fe4-41bd-8d86-67be9e585704', 'af3d1f0f-2de4-4d7d-bb80-627890c293b9'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[94060c60-d436-4550-9686-6ab599f588da]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_m1z7e4oq {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:47 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:47 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:47 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_m1z7e4oq Sep 28 12:32:47 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:47 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.300s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:47 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Deleted volume successfully. Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4645e54e-ad5c-4c07-ae5c-655ad4030fac tempest-CreateVolumesFromImageTest-460262223 None] Lock "cinder-9382b261-cdd3-4263-a749-5e40fb1b749a-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:47 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_m1z7e4oq" returned: 0 in 0.427s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_m1z7e4oq {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:48 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb 1073741824" returned: 0 in 0.611s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:48 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_m1z7e4oq Sep 28 12:32:48 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:48 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb Sep 28 12:32:48 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:48 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb" returned: 0 in 0.264s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:48 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.487s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "cinder-quobyte-f395529c-f798-4d13-a934-5fa6acb546c9-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" by "_create_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_m1z7e4oq" returned: 1 in 0.391s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_m1z7e4oq' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[85229780-74b9-49ee-845a-63e5ac96d2e9]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b76891c-ac01-487d-adc1-b170c26bf818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10f9a325-67cb-4b7b-9460-99df6746e7cb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aac242c-4392-44d5-9f8a-6394b2e2acc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-f395529c-f798-4d13-a934-5fa6acb546c9-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" acquired by "_create_volume_from_snapshot" :: waited 0.043s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Creating volume 2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 from snapshot f395529c-f798-4d13-a934-5fa6acb546c9 {{(pid=87048) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "cinder-quobyte-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:48 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Volume volume-10f9a325-67cb-4b7b-9460-99df6746e7cb (10f9a325-67cb-4b7b-9460-99df6746e7cb): created successfully Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aac242c-4392-44d5-9f8a-6394b2e2acc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Flow 'volume_create_manager' (6e2f5586-e321-48f0-9eb6-9e835ec322a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] snapshot: f395529c-f798-4d13-a934-5fa6acb546c9, volume: 2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:32:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-81973fce-a921-431d-bf0a-0f0b47f3d746 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created volume successfully. Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:48 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD Sep 28 12:32:48 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f65f90b-8036-4430-a5cf-b2757e193c80]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:48 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 Sep 28 12:32:48 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-10f9a325-67cb-4b7b-9460-99df6746e7cb-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:48 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-10f9a325-67cb-4b7b-9460-99df6746e7cb-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-quobyte-10f9a325-67cb-4b7b-9460-99df6746e7cb" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-10f9a325-67cb-4b7b-9460-99df6746e7cb" acquired by "delete_volume" :: waited 0.049s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:48 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD Sep 28 12:32:48 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f90ddd-384e-4e5c-b5c8-71efb3aa2cc3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:49 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9" returned: 0 in 0.594s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eaf1e87-4657-4734-9bf6-227af87a23bf]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:49 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb Sep 28 12:32:49 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:49 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] 9c868ae9-a14e-4718-8f7e-5177ea3a30d2 was raw, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:49 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 Sep 28 12:32:49 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:49 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 Sep 28 12:32:49 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:49 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb" returned: 0 in 0.485s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:49 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb Sep 28 12:32:49 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:49 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" returned: 0 in 0.470s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:49 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 Sep 28 12:32:49 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:49 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14" returned: 0 in 0.622s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9c868ae9-a14e-4718-8f7e-5177ea3a30d2_dbe27j4bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:32:49 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:49 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-10f9a325-67cb-4b7b-9460-99df6746e7cb" returned: 0 in 0.348s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:49 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 1G Sep 28 12:32:49 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-10f9a325-67cb-4b7b-9460-99df6746e7cb" released by "delete_volume" :: held 0.941s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created reservations ['9eb814e4-5b4f-4b32-afe0-19227dbfb2fa', '5a94e703-6385-482f-a413-f6eb4b7863c1', '23bde113-5a83-48d2-b978-c697e9e02f25', '849a36ec-6224-4597-bf57-76c25f52c5a7'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:50 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:50 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:50 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 1G" returned: 0 in 0.540s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Downloaded image 9c868ae9-a14e-4718-8f7e-5177ea3a30d2 ((None, [{'url': 'file:///opt/stack/data/glance/images/9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'metadata': {}}])) to volume 78c9fb8a-3265-4109-8f5f-3916fa4a5a14 successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Temporary image 9c868ae9-a14e-4718-8f7e-5177ea3a30d2 for user cf8a68cfd48f40478ddfdf71e84bcc5a is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Marking volume 78c9fb8a-3265-4109-8f5f-3916fa4a5a14 as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Copying metadata from image 9c868ae9-a14e-4718-8f7e-5177ea3a30d2 to 78c9fb8a-3265-4109-8f5f-3916fa4a5a14. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Creating volume glance metadata for volume 78c9fb8a-3265-4109-8f5f-3916fa4a5a14 backed by image 9c868ae9-a14e-4718-8f7e-5177ea3a30d2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6d68e85b86422ceb0b031f79e1274ee7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:32:50 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.403s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:50 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Deleted volume successfully. Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca75d715-9388-4a8e-9171-34708dcbf311 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-10f9a325-67cb-4b7b-9460-99df6746e7cb-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df077c99-a5ab-4dc4-8aae-0932e826e458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14', 'volume_size': 1, 'image_id': '9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d68e85b86422ceb0b031f79e1274ee7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '271acfc01b964d3a83df3d6ea91db743', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd71bef88b17fd948ab7588d029c7a4f6f066ca5eb34a0391bde6c20ad2b4053335ade7f8f5e7857430b2f16f3eb0ceb8c3b87e6be18cf872aaae63aaf93002d8', 'id': '9c868ae9-a14e-4718-8f7e-5177ea3a30d2', 'created_at': datetime.datetime(2026, 9, 28, 10, 32, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 32, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9c868ae9-a14e-4718-8f7e-5177ea3a30d2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11907841-1824-4d65-b4f2-8a3ce1c219dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:50 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Volume volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 (78c9fb8a-3265-4109-8f5f-3916fa4a5a14): created successfully Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11907841-1824-4d65-b4f2-8a3ce1c219dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Flow 'volume_create_manager' (d7412461-1149-4573-b25e-bf2c4e82f0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:50 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-fc4df849-4c01-434f-b096-8e86934c926a tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Created volume successfully. Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Acquiring lock "cinder-78c9fb8a-3265-4109-8f5f-3916fa4a5a14-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-3b13a1a3-7cfd-421c-bb2e-8549cc229306-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "cinder-78c9fb8a-3265-4109-8f5f-3916fa4a5a14-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-3b13a1a3-7cfd-421c-bb2e-8549cc229306-delete_volume" acquired by "delete_volume" :: waited 0.127s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Acquiring lock "cinder-quobyte-78c9fb8a-3265-4109-8f5f-3916fa4a5a14" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "cinder-quobyte-78c9fb8a-3265-4109-8f5f-3916fa4a5a14" acquired by "delete_volume" :: waited 0.047s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-quobyte-3b13a1a3-7cfd-421c-bb2e-8549cc229306" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-3b13a1a3-7cfd-421c-bb2e-8549cc229306" acquired by "delete_volume" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5d8ab4-b539-4b14-8f06-29301bcd4f6e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44bb9bc-80a1-4c56-ad81-ee5db6710eca]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:51 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 Sep 28 12:32:51 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:52 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 Sep 28 12:32:52 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:52 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306" returned: 0 in 0.885s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:52 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306 Sep 28 12:32:52 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:52 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14" returned: 0 in 1.052s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:52 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14 Sep 28 12:32:52 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:53 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3b13a1a3-7cfd-421c-bb2e-8549cc229306" returned: 0 in 0.591s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-3b13a1a3-7cfd-421c-bb2e-8549cc229306" released by "delete_volume" :: held 1.588s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:53 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-78c9fb8a-3265-4109-8f5f-3916fa4a5a14" returned: 0 in 0.557s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "cinder-quobyte-78c9fb8a-3265-4109-8f5f-3916fa4a5a14" released by "delete_volume" :: held 1.776s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created reservations ['c06060e6-8a36-4f68-90bd-cb931962319f', '02dd7505-532e-434c-b154-da6c5a659db6', '1688d71f-27fb-4308-bd3d-0c77f516d427', '37fe5eed-7721-42bb-8ae3-1038d17886b0'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Created reservations ['85fb58cd-4f02-4ab7-8030-80e1f1db849a', 'e2e7d989-0053-49ec-97d2-a24fa10d06a0', '307f5821-bd55-4b62-b048-17ca78bec628', '00cece2a-d6c9-4a87-a673-2939939080ca'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:53 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:53 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:53 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:53 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-15b39e87-d287-4ef6-a754-1fb83ce54a68-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-15b39e87-d287-4ef6-a754-1fb83ce54a68-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-quobyte-15b39e87-d287-4ef6-a754-1fb83ce54a68" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-15b39e87-d287-4ef6-a754-1fb83ce54a68" acquired by "delete_volume" :: waited 0.053s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:54 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.542s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[628eaa90-bc2b-411e-8929-753212f37fbe]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:54 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Deleted volume successfully. Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3b8f0849-a8e4-40f8-93de-14970fbcf139 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-3b13a1a3-7cfd-421c-bb2e-8549cc229306-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:54 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.686s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:54 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Deleted volume successfully. Sep 28 12:32:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-4fd267e5-88c5-4d19-8c23-80d42b634632 tempest-VolumeAndVolumeTypeFromImageTest-473719397 None] Lock "cinder-78c9fb8a-3265-4109-8f5f-3916fa4a5a14-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:54 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 Sep 28 12:32:54 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:55 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68" returned: 0 in 1.035s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:55 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68 Sep 28 12:32:55 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:55 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-15b39e87-d287-4ef6-a754-1fb83ce54a68" returned: 0 in 0.505s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:55 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-15b39e87-d287-4ef6-a754-1fb83ce54a68" released by "delete_volume" :: held 1.697s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:55 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created reservations ['72b024cf-3575-4055-9bea-f5b271266f57', '3ca229e2-0107-4339-be6a-fae8b4242256', 'def68a86-2d33-41db-a1d0-9dba5ad4e3df', '1ea32205-67f7-4dd6-8948-b8eba2b89bfa'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:56 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:56 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-2bfc3d1d-0832-4004-9f8d-83240a339e36-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-2bfc3d1d-0832-4004-9f8d-83240a339e36-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-quobyte-2bfc3d1d-0832-4004-9f8d-83240a339e36" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-2bfc3d1d-0832-4004-9f8d-83240a339e36" acquired by "delete_volume" :: waited 0.051s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6117bc12-47b2-4c63-9496-7a9c7f97078d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:56 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.758s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:56 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Deleted volume successfully. Sep 28 12:32:56 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 Sep 28 12:32:56 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:56 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-53cc40d7-2f4d-42b6-9379-357bb9e84be7 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-15b39e87-d287-4ef6-a754-1fb83ce54a68-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:57 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36" returned: 0 in 0.772s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:57 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36 Sep 28 12:32:57 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:57 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2bfc3d1d-0832-4004-9f8d-83240a339e36" returned: 0 in 0.571s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-2bfc3d1d-0832-4004-9f8d-83240a339e36" released by "delete_volume" :: held 1.468s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created reservations ['a0e0bf7f-808c-4f3a-9d63-98bd2e0b440c', '2dfcf87c-6bd0-4755-a879-87a291a5822d', '58704dbf-fee0-4515-8ca8-fb5dd92d6997', 'db271d29-244b-430a-b904-4d18c4c3eb10'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:58 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:32:58 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:58 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.403s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:32:58 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Deleted volume successfully. Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3bb03a3f-4cb4-4f91-bd80-e767c7f340b2 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-2bfc3d1d-0832-4004-9f8d-83240a339e36-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-5d83f211-1e4e-456e-bc5c-29f07198a38e-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-5d83f211-1e4e-456e-bc5c-29f07198a38e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-quobyte-5d83f211-1e4e-456e-bc5c-29f07198a38e" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-5d83f211-1e4e-456e-bc5c-29f07198a38e" acquired by "delete_volume" :: waited 0.043s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[773668c5-6905-4d3b-8659-cafcfc080fcf]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:59 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" returned: 0 in 9.685s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5, size 1024.00 MB, duration 9.69 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:32:59 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Converted 1024.00 MB image at 105.72 MB/s Sep 28 12:32:59 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 is being set with open permissions: ugo+rw Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:59 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 Sep 28 12:32:59 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:59 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e Sep 28 12:32:59 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:59 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" returned: 0 in 0.274s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" released by "_copy_volume_from_snapshot" :: held 11.139s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-f395529c-f798-4d13-a934-5fa6acb546c9-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" released by "_create_volume_from_snapshot" :: held 11.244s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.289s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:32:59 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e" returned: 0 in 0.490s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b113eaf8-a626-48cb-9b77-284d53cb5c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26', 'volume_size': 1, 'snapshot_id': 'f395529c-f798-4d13-a934-5fa6acb546c9'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:59 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e Sep 28 12:32:59 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d6c262-343b-4533-85c4-270d2bb7e150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:32:59 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Volume volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 (2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26): created successfully Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8d6c262-343b-4533-85c4-270d2bb7e150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Flow 'volume_create_manager' (5f3b9fb2-8423-4add-9448-94501aacc855) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:32:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ed735264-ec78-4073-9caa-d49069ca5d4e tempest-VolumeDependencyTests-1986263950 None] Created volume successfully. Sep 28 12:32:59 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 28 12:32:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-5d83f211-1e4e-456e-bc5c-29f07198a38e" returned: 0 in 0.312s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-5d83f211-1e4e-456e-bc5c-29f07198a38e" released by "delete_volume" :: held 0.894s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created reservations ['aa492aa1-3e43-4e0d-9f9f-2a940d9356ef', 'e9889b48-8db5-4210-8113-81f01dfa7b42', '26b547c5-4294-442f-b623-9e745945c1da', '444452c0-61a6-493e-9dae-d57fde9e49d9'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:00 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:00 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-287ff068-7a07-4211-9f49-70bea9ef8857-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-287ff068-7a07-4211-9f49-70bea9ef8857-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "cinder-f395529c-f798-4d13-a934-5fa6acb546c9-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-f395529c-f798-4d13-a934-5fa6acb546c9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "cinder-quobyte-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "cinder-quobyte-287ff068-7a07-4211-9f49-70bea9ef8857" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "cinder-quobyte-f395529c-f798-4d13-a934-5fa6acb546c9" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-287ff068-7a07-4211-9f49-70bea9ef8857" acquired by "delete_volume" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-f395529c-f798-4d13-a934-5fa6acb546c9" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Deleting offline snapshot f395529c-f798-4d13-a934-5fa6acb546c9 of volume e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] snapshot_file for this snap is: volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df194a-fc99-4315-a054-750f5f42395d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf13d1b-276d-4fdd-a2c4-31e0ef6273ea]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:00 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.437s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:00 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Deleted volume successfully. Sep 28 12:33:00 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857 Sep 28 12:33:00 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0ba2b973-22f2-41f0-8199-197fb515f101 tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-5d83f211-1e4e-456e-bc5c-29f07198a38e-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:00 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 Sep 28 12:33:00 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:00 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857" returned: 0 in 0.422s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:00 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857 Sep 28 12:33:00 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:01 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9" returned: 0 in 0.513s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2305ed-0f80-4d95-98cd-5af9bd479603]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:01 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 Sep 28 12:33:01 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:01 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-287ff068-7a07-4211-9f49-70bea9ef8857" returned: 0 in 0.328s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-quobyte-287ff068-7a07-4211-9f49-70bea9ef8857" released by "delete_volume" :: held 0.828s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Created reservations ['d0d35877-ee0f-447d-8403-77cd35aec3fe', '2d17d9f1-a1ce-4fd6-bfa6-66e8716a440b', '458c83a5-80b6-44c3-925a-27d3c70ba187', '5b0204b4-ca40-46c2-9209-5aa67721b322'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:01 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:01 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:01 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.358s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Deleted volume successfully. Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6b67bebe-afc5-4cdf-967a-dfaa6e1b1c1d tempest-CreateVolumesFromSourceVolumeTest-1487850124 None] Lock "cinder-287ff068-7a07-4211-9f49-70bea9ef8857-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:01 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" returned: 0 in 0.767s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:01 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 Sep 28 12:33:01 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:02 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9" returned: 0 in 0.428s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:02 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9 Sep 28 12:33:02 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (1de3a0ab-bd12-47b3-af6d-8a0fcc7a0054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6083cb8e-6481-4ce5-b52c-14d712d21c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:02 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5.f395529c-f798-4d13-a934-5fa6acb546c9" returned: 0 in 0.294s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6083cb8e-6481-4ce5-b52c-14d712d21c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-154250134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cf580f-751d-427a-b0b1-fa5c60da8f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:02Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4129b8f8-703c-4e01-a71e-c9efdabafc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4129b8f8-703c-4e01-a71e-c9efdabafc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bf5242-f38b-4fde-b237-9f1b62a5a58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bf5242-f38b-4fde-b237-9f1b62a5a58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17cf580f-751d-427a-b0b1-fa5c60da8f3f', 'volume_name': 'volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425588c1-cd92-49a0-b456-934bbe3d3a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425588c1-cd92-49a0-b456-934bbe3d3a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2a2376-8236-4f34-b241-fc68a3103b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:02 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume 17cf580f-751d-427a-b0b1-fa5c60da8f3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f', 'volume_size': 1} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-154250134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cf580f-751d-427a-b0b1-fa5c60da8f3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:02Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Creating volume 17cf580f-751d-427a-b0b1-fa5c60da8f3f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:02 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:02 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f 1073741824 Sep 28 12:33:02 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-f395529c-f798-4d13-a934-5fa6acb546c9" released by "_delete_snapshot" :: held 2.241s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" released by "delete_snapshot" :: held 2.293s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Created reservations ['61a9e9a1-c2bb-441b-b37b-3318e0061e71', 'd4d1e248-5fde-49fc-98e4-49f5b1a711cc', '40dbcedc-eb98-4da7-a5c8-f84fa743719e', 'bdf330ab-fcb7-4d81-b35a-46ca5abf7d9c'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:02 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Delete snapshot completed successfully. Sep 28 12:33:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-47c4a7a0-1e83-4938-8b58-72534d2209c8 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-f395529c-f798-4d13-a934-5fa6acb546c9-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:03 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f 1073741824" returned: 0 in 0.553s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:03 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f Sep 28 12:33:03 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:03 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f" returned: 0 in 0.321s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff2a2376-8236-4f34-b241-fc68a3103b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5266bb-26d8-4ffc-b5cd-b5e5b4b241cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:03 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f (17cf580f-751d-427a-b0b1-fa5c60da8f3f): created successfully Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5266bb-26d8-4ffc-b5cd-b5e5b4b241cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (1de3a0ab-bd12-47b3-af6d-8a0fcc7a0054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:03 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-762f7ae7-231a-4cce-885b-6d620296ad9b tempest-CreateVolumesFromSnapshotTest-142651388 None] Created volume successfully. Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "cinder-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:03 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "cinder-quobyte-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" acquired by "delete_volume" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4420f9be-2e8a-4993-80c2-840d96d4126b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:04 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 Sep 28 12:33:04 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:04 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" returned: 0 in 0.387s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:04 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5 Sep 28 12:33:04 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" returned: 0 in 0.306s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:04 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5" released by "delete_volume" :: held 0.813s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Creating offline snapshot 70d93436-1f4a-4aac-918b-770edd5b7f32 of volume 17cf580f-751d-427a-b0b1-fa5c60da8f3f {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[55840a7b-1d93-4ab7-96e2-14a7497377c1]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:04 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Created reservations ['de24899b-4960-45c4-b63f-db4c4c73c53d', '77b9f3bf-e8f0-4441-88ef-e21bc22832d2', '0192ee07-b22c-453c-b19b-c266779156d6', '955eff4f-cb01-4f6c-baa5-f9f46b47e2c2'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:05 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f Sep 28 12:33:05 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:05 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:05 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "cinder-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "cinder-quobyte-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" acquired by "delete_volume" :: waited 0.029s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1666a1fc-2685-4b46-b269-2837f257ffd8]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:05 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f" returned: 0 in 0.554s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:05 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.450s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:05 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Deleted volume successfully. Sep 28 12:33:05 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 1G Sep 28 12:33:05 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-22d7a942-b92f-4a7b-ab45-d22f9c973e3b tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-e2e26f0c-b47e-445f-a8ae-2d31a6d4bea5-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:05 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 Sep 28 12:33:05 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:05 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" returned: 0 in 0.638s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:06 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26 Sep 28 12:33:06 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:06 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 1G" returned: 0 in 0.567s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:06 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 Sep 28 12:33:06 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:06 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-quobyte-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26" released by "delete_volume" :: held 1.052s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Created reservations ['9c5b1808-6dab-46f6-bd69-7f957557bf2d', '04a074ae-a3a4-4429-a1c8-43c6e9d71036', '1308ded3-b6ba-49db-9acb-86df46b52f5b', '7f519314-0b9a-4153-909a-9dae21ff2016'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:06 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32" returned: 0 in 0.415s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:06 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 is being set with open permissions: ugo+rw Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:06 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 Sep 28 12:33:06 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:06 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:06 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:06 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32" returned: 0 in 0.262s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:06 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.info Sep 28 12:33:06 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:06 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.283s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Deleted volume successfully. Sep 28 12:33:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7480d503-7362-4d4f-b68b-54b28a470c74 tempest-VolumeDependencyTests-1986263950 None] Lock "cinder-2ad7abd4-e1cb-4af0-aaa8-ab2b478f3f26-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:07 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.info" returned: 0 in 0.279s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:07 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.info is being set with open permissions: ugo+rw Sep 28 12:33:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:07 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.info Sep 28 12:33:07 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:07 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.info" returned: 0 in 0.250s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.473s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:07 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1e05ed18-3a7d-4cdf-b62a-e2b51225ea4e tempest-CreateVolumesFromSnapshotTest-142651388 None] Create snapshot completed successfully Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (2a234d8d-4fd9-47d1-a1e2-86ff410a8243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2024c1a-6684-4b73-91e7-aaacddfb8310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2024c1a-6684-4b73-91e7-aaacddfb8310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1604817337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6dc7d7-528b-4b9d-a8cf-2233a649e717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:09Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce41c06-e4aa-4bfa-8cd9-d1543d747d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce41c06-e4aa-4bfa-8cd9-d1543d747d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4db43f-6912-4faa-9f67-98d8b929445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea4db43f-6912-4faa-9f67-98d8b929445f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d6dc7d7-528b-4b9d-a8cf-2233a649e717', 'volume_name': 'volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94918a7-29ca-4e0a-8424-c27d2fe2d0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c94918a7-29ca-4e0a-8424-c27d2fe2d0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8698eac9-11a9-478f-8890-b47603f211c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:08 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume 6d6dc7d7-528b-4b9d-a8cf-2233a649e717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717', 'volume_size': 1} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1604817337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6dc7d7-528b-4b9d-a8cf-2233a649e717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:09Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Creating volume 6d6dc7d7-528b-4b9d-a8cf-2233a649e717 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:08 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:08 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 1073741824 Sep 28 12:33:08 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (a2cfbfe3-401d-48f8-baac-486a63fd0d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6442764f-25da-48ca-a42d-dc57a198afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6442764f-25da-48ca-a42d-dc57a198afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1628034667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d4be12-7180-44d9-a9f2-5c8eed4794ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:09Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca35e4b-d646-4c1d-b8fa-cfcb64c6cdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca35e4b-d646-4c1d-b8fa-cfcb64c6cdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19034a78-a264-4331-aaa1-244606a6b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19034a78-a264-4331-aaa1-244606a6b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20d4be12-7180-44d9-a9f2-5c8eed4794ab', 'volume_name': 'volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdfecac-c432-4478-9fa4-f46e6d404fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fdfecac-c432-4478-9fa4-f46e6d404fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b9d86d-56eb-4deb-be61-4449592a1f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:09 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume 20d4be12-7180-44d9-a9f2-5c8eed4794ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab', 'volume_size': 1} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:09 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 1073741824" returned: 0 in 0.772s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:09 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 Sep 28 12:33:09 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:09 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (622cd087-e8b7-4d3b-8373-056cd395f378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099017fa-c5e1-40ee-a129-89896b8f7818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099017fa-c5e1-40ee-a129-89896b8f7818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215018382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354967d1-5f65-4be8-bfc5-0f7b0eb70ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:10Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36db70ea-0fa8-42fd-918d-996152a995e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36db70ea-0fa8-42fd-918d-996152a995e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0808dea-a799-49e9-ace2-9062832f9a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0808dea-a799-49e9-ace2-9062832f9a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354967d1-5f65-4be8-bfc5-0f7b0eb70ae0', 'volume_name': 'volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720bf1f1-3abb-4d7f-93f5-d1a406fc8a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720bf1f1-3abb-4d7f-93f5-d1a406fc8a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d393745-a61b-436a-857f-87dda3a1ce84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume 354967d1-5f65-4be8-bfc5-0f7b0eb70ae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0', 'volume_size': 1} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:10 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717" returned: 0 in 0.535s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1628034667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d4be12-7180-44d9-a9f2-5c8eed4794ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:09Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Creating volume 20d4be12-7180-44d9-a9f2-5c8eed4794ab {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:10 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8698eac9-11a9-478f-8890-b47603f211c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab 1073741824 Sep 28 12:33:10 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9b105f-8e70-4e5c-86be-5ab511722216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 (6d6dc7d7-528b-4b9d-a8cf-2233a649e717): created successfully Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9b105f-8e70-4e5c-86be-5ab511722216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (2a234d8d-4fd9-47d1-a1e2-86ff410a8243) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:10 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c5c16339-fdf0-42bd-bf50-c6d42ee0e886 tempest-CreateVolumesFromSnapshotTest-142651388 None] Created volume successfully. Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (d9384183-5014-4be9-9767-a249900cfe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98769a46-7e05-4e09-b738-4aafde6369ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98769a46-7e05-4e09-b738-4aafde6369ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744217095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503f7d20-189d-43b4-8d83-2cba3106d1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:11Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425106d0-46c8-48b3-a91f-20a9c8a17946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (425106d0-46c8-48b3-a91f-20a9c8a17946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f98a1a-c20d-4389-b265-464fd5c94f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f98a1a-c20d-4389-b265-464fd5c94f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '503f7d20-189d-43b4-8d83-2cba3106d1e6', 'volume_name': 'volume-503f7d20-189d-43b4-8d83-2cba3106d1e6', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca16bd4-38a7-4b0a-bfc8-ca31fda5659e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca16bd4-38a7-4b0a-bfc8-ca31fda5659e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1639a394-487c-43d5-a9c1-747dd568d797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:10 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume 503f7d20-189d-43b4-8d83-2cba3106d1e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-503f7d20-189d-43b4-8d83-2cba3106d1e6', 'volume_size': 1} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:10 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab 1073741824" returned: 0 in 0.681s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:11 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab Sep 28 12:33:11 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (586b4478-edba-4a37-9f52-1e58088f5ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (674066a9-b262-4c38-b9c6-95da06cef9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (674066a9-b262-4c38-b9c6-95da06cef9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606099573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cefc64-dc8b-464b-b245-c802bfbe375e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:11Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa289c7-668c-4b2f-a9c6-56c4bf5c21b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa289c7-668c-4b2f-a9c6-56c4bf5c21b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4979e5-2e77-4ee8-8c6f-0891d0f4edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd4979e5-2e77-4ee8-8c6f-0891d0f4edcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66cefc64-dc8b-464b-b245-c802bfbe375e', 'volume_name': 'volume-66cefc64-dc8b-464b-b245-c802bfbe375e', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea88ed6-96c7-476b-ac38-e245b74efe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ea88ed6-96c7-476b-ac38-e245b74efe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43638248-ac42-4abd-a864-decf38ec2d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:11 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume 66cefc64-dc8b-464b-b245-c802bfbe375e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66cefc64-dc8b-464b-b245-c802bfbe375e', 'volume_size': 1} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:11 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab" returned: 0 in 0.361s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.206s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-215018382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354967d1-5f65-4be8-bfc5-0f7b0eb70ae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:10Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Creating volume 354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:11 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b9d86d-56eb-4deb-be61-4449592a1f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:11 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 1073741824 Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54b4238-b789-483c-9361-d54330e3b2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:11 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:11 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab (20d4be12-7180-44d9-a9f2-5c8eed4794ab): created successfully Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b54b4238-b789-483c-9361-d54330e3b2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (a2cfbfe3-401d-48f8-baac-486a63fd0d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:11 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f4a90bd1-cb49-43d4-bcc2-f3cf8e9a2ae0 tempest-CreateVolumesFromSnapshotTest-142651388 None] Created volume successfully. Sep 28 12:33:11 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 1073741824" returned: 0 in 0.533s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:11 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 Sep 28 12:33:11 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:12 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0" returned: 0 in 0.290s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-744217095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=503f7d20-189d-43b4-8d83-2cba3106d1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:11Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Creating volume 503f7d20-189d-43b4-8d83-2cba3106d1e6 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:12 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d393745-a61b-436a-857f-87dda3a1ce84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f106e9-ae24-4c34-bab1-450b26891f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:12 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 1073741824 Sep 28 12:33:12 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:12 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 (354967d1-5f65-4be8-bfc5-0f7b0eb70ae0): created successfully Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f106e9-ae24-4c34-bab1-450b26891f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (622cd087-e8b7-4d3b-8373-056cd395f378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:12 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-46724232-a327-44e5-89b6-d47d86b4266a tempest-CreateVolumesFromSnapshotTest-142651388 None] Created volume successfully. Sep 28 12:33:12 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 1073741824" returned: 0 in 0.572s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:12 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 Sep 28 12:33:12 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:13 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-606099573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cefc64-dc8b-464b-b245-c802bfbe375e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fce1092fa9b14f07b2c3f641ff499520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:11Z,use_quota=True,user_id='9916cd3b98784b2c8d6e00649b93da73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Creating volume 66cefc64-dc8b-464b-b245-c802bfbe375e {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:13 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:13 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e 1073741824 Sep 28 12:33:13 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1639a394-487c-43d5-a9c1-747dd568d797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-503f7d20-189d-43b4-8d83-2cba3106d1e6', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d1fcd3-6f4e-4c34-b1fe-d38301e79d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:13 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 (503f7d20-189d-43b4-8d83-2cba3106d1e6): created successfully Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2d1fcd3-6f4e-4c34-b1fe-d38301e79d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (d9384183-5014-4be9-9767-a249900cfe8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-438f09fe-0c3e-4c55-9d1b-4d6669c82fc5 tempest-CreateVolumesFromSnapshotTest-142651388 None] Created volume successfully. Sep 28 12:33:13 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e 1073741824" returned: 0 in 0.624s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:13 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e Sep 28 12:33:13 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:14 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e" returned: 0 in 0.344s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43638248-ac42-4abd-a864-decf38ec2d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66cefc64-dc8b-464b-b245-c802bfbe375e', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd92b16-7b06-4e0c-b07f-92300d49a9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:14 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Volume volume-66cefc64-dc8b-464b-b245-c802bfbe375e (66cefc64-dc8b-464b-b245-c802bfbe375e): created successfully Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd92b16-7b06-4e0c-b07f-92300d49a9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Flow 'volume_create_manager' (586b4478-edba-4a37-9f52-1e58088f5ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:14 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-eec4fed8-4f92-479d-ae27-93b3650bfe55 tempest-CreateVolumesFromSnapshotTest-142651388 None] Created volume successfully. Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-66cefc64-dc8b-464b-b245-c802bfbe375e-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-66cefc64-dc8b-464b-b245-c802bfbe375e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-quobyte-66cefc64-dc8b-464b-b245-c802bfbe375e" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-66cefc64-dc8b-464b-b245-c802bfbe375e" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e690461-a37d-4f7c-931f-d30f248baff5]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:14 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e Sep 28 12:33:14 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:15 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e" returned: 0 in 0.420s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:15 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e Sep 28 12:33:15 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:15 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-66cefc64-dc8b-464b-b245-c802bfbe375e" returned: 0 in 0.356s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-66cefc64-dc8b-464b-b245-c802bfbe375e" released by "delete_volume" :: held 0.849s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Created reservations ['dadc8ef4-c646-4c87-9437-ce1a77e2fa07', '6f247625-f1e7-4b1b-bb1b-68803a483f21', '5c2f90d3-be08-4963-8c09-5db406d8d65f', 'cd7d174b-a48d-419e-b179-d17d5a84fc85'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:15 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:15 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-503f7d20-189d-43b4-8d83-2cba3106d1e6-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-503f7d20-189d-43b4-8d83-2cba3106d1e6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-quobyte-503f7d20-189d-43b4-8d83-2cba3106d1e6" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Flow 'volume_create_manager' (aa7b71c5-63b1-47ed-be95-aa31bc487928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04858ba3-ce5e-4a46-b1a2-8dcb6f4eae5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-503f7d20-189d-43b4-8d83-2cba3106d1e6" acquired by "delete_volume" :: waited 0.075s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:16 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[091b156c-58d1-41af-9fe5-27714ff76c16]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04858ba3-ce5e-4a46-b1a2-8dcb6f4eae5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b650c4-0d84-4677-ae34-28c41cefb9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091ab479e72d44d28f6deac13371acb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:16Z,use_quota=True,user_id='478c1de4deea46ebbcfd1c7a67a3f4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abdf38f-a499-4a89-9c47-5f064a1f1f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abdf38f-a499-4a89-9c47-5f064a1f1f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c776ae7b-9537-4afd-b432-af26a8ca0719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.image.glance [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Creating Keystone auth plugin from conf {{(pid=87048) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.454s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Deleted volume successfully. Sep 28 12:33:16 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 Sep 28 12:33:16 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-35a210a2-605b-4dce-bbfc-a7d0d5d9c00b tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-66cefc64-dc8b-464b-b245-c802bfbe375e-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:16 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6" returned: 0 in 0.488s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:16 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6 Sep 28 12:33:16 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c776ae7b-9537-4afd-b432-af26a8ca0719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b4b650c4-0d84-4677-ae34-28c41cefb9fb', 'volume_name': 'volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb', 'volume_size': 1, 'image_id': 'e592858f-34f0-46d1-8d24-52b04c504680', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e592858f-34f0-46d1-8d24-52b04c504680', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c871d8067cd7135417bea9a31e301b7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '091ab479e72d44d28f6deac13371acb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24b82498dbe00ea046c1d42b04b1f1a6eb657c51c7c183119d7328365be128649ec4ee489b6730d88ca7e8f4e2f06504c467a4df39dbc698f2e2c8e1e94902f4', 'id': 'e592858f-34f0-46d1-8d24-52b04c504680', 'created_at': datetime.datetime(2026, 9, 28, 10, 33, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 33, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e592858f-34f0-46d1-8d24-52b04c504680/file', 'properties': {}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092feb52-4ef5-4446-af44-085790b29095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092feb52-4ef5-4446-af44-085790b29095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc537829-17ac-404f-853a-bcf051ce3d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:16 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Volume b4b650c4-0d84-4677-ae34-28c41cefb9fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb', 'volume_size': 1, 'image_id': 'e592858f-34f0-46d1-8d24-52b04c504680', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e592858f-34f0-46d1-8d24-52b04c504680', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c871d8067cd7135417bea9a31e301b7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '091ab479e72d44d28f6deac13371acb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24b82498dbe00ea046c1d42b04b1f1a6eb657c51c7c183119d7328365be128649ec4ee489b6730d88ca7e8f4e2f06504c467a4df39dbc698f2e2c8e1e94902f4', 'id': 'e592858f-34f0-46d1-8d24-52b04c504680', 'created_at': datetime.datetime(2026, 9, 28, 10, 33, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 33, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e592858f-34f0-46d1-8d24-52b04c504680/file', 'properties': {}}, 'image_service': } Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Trying to clone b4b650c4-0d84-4677-ae34-28c41cefb9fb from image e592858f-34f0-46d1-8d24-52b04c504680 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e592858f-34f0-46d1-8d24-52b04c504680', 'metadata': {}}]). {{(pid=87048) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 12:33:16 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 12:33:16 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Image download 0.00 MB at 0.00 MB/s Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c323fba-2961-4dd4-9c54-bbd099ffdaf8]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:17 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-503f7d20-189d-43b4-8d83-2cba3106d1e6" returned: 0 in 0.385s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-503f7d20-189d-43b4-8d83-2cba3106d1e6" released by "delete_volume" :: held 0.985s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Created reservations ['36f45fc1-6037-4f8d-8e23-66d4d2813d2b', '90b53b5c-3567-4bb7-93e4-6a3662773bc5', '16f80b82-0e88-4450-82ca-59b133c3daf3', '08e6018b-337f-443c-8bff-3fdcc2c82acf'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:17 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD Sep 28 12:33:17 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:17 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:17 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:17 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:17 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Deleted volume successfully. Sep 28 12:33:17 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD Sep 28 12:33:17 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-88a500b0-5f2f-45b4-9295-7a6778ab2e0e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-503f7d20-189d-43b4-8d83-2cba3106d1e6-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:17 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Temporary image e592858f-34f0-46d1-8d24-52b04c504680 is fetched for user 478c1de4deea46ebbcfd1c7a67a3f4df. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ce62d5-64b7-4b40-aeca-f02b1eb34ea5]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:17 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD Sep 28 12:33:17 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:18 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-quobyte-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[97eb0aa5-a158-4590-b798-d39eff54901b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:18 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD Sep 28 12:33:18 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:18 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 Sep 28 12:33:18 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:18 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4b650c4-0d84-4677-ae34-28c41cefb9fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='091ab479e72d44d28f6deac13371acb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:16Z,use_quota=True,user_id='478c1de4deea46ebbcfd1c7a67a3f4df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Creating volume b4b650c4-0d84-4677-ae34-28c41cefb9fb {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:18 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:18 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb 1073741824 Sep 28 12:33:18 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:18 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0" returned: 0 in 0.480s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:18 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0 Sep 28 12:33:18 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:19 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0" returned: 0 in 0.395s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0" released by "delete_volume" :: held 0.942s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:19 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb 1073741824" returned: 0 in 0.621s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Created reservations ['5008628a-c4fe-4710-b9c4-7b95548932d4', '46d2cc02-598b-4161-bda9-3d36bbcaa1cb', '7cfa42c4-ce03-4e4d-aa8c-40bf84dbcc31', '114a35e5-1c40-4416-b363-5b24dad0aaa3'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:19 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb Sep 28 12:33:19 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:19 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:19 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:19 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb" returned: 0 in 0.323s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:19 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Attempting download of e592858f-34f0-46d1-8d24-52b04c504680 ((None, [{'url': 'file:///opt/stack/data/glance/images/e592858f-34f0-46d1-8d24-52b04c504680', 'metadata': {}}])) to volume b4b650c4-0d84-4677-ae34-28c41cefb9fb. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.292s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:19 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Deleted volume successfully. Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6fd6b3a0-6d53-4a68-9f20-41379e0d8174 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-354967d1-5f65-4be8-bfc5-0f7b0eb70ae0-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e4bc8-5452-49c9-84b5-40b7537c38d0]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e592858f-34f0-46d1-8d24-52b04c504680_gfn8dni6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:19 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e592858f-34f0-46d1-8d24-52b04c504680_gfn8dni6 Sep 28 12:33:19 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:20 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e592858f-34f0-46d1-8d24-52b04c504680_gfn8dni6" returned: 0 in 0.373s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e592858f-34f0-46d1-8d24-52b04c504680_gfn8dni6 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:20 devstack sudo[106383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e592858f-34f0-46d1-8d24-52b04c504680_gfn8dni6 Sep 28 12:33:20 devstack sudo[106383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-20d4be12-7180-44d9-a9f2-5c8eed4794ab-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-20d4be12-7180-44d9-a9f2-5c8eed4794ab-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-quobyte-20d4be12-7180-44d9-a9f2-5c8eed4794ab" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-20d4be12-7180-44d9-a9f2-5c8eed4794ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e9ec78-8819-498e-93ce-d5d639eed227]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:20 devstack sudo[106383]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e592858f-34f0-46d1-8d24-52b04c504680_gfn8dni6" returned: 1 in 0.454s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e592858f-34f0-46d1-8d24-52b04c504680_gfn8dni6' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9270c41-7e4a-47ff-8b66-e31c781e512a]: (4, 'raw') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:20 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD Sep 28 12:33:20 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:20 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab Sep 28 12:33:20 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:21 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:21 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab" returned: 0 in 0.566s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:21 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD Sep 28 12:33:21 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:21 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab Sep 28 12:33:21 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:21 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] e592858f-34f0-46d1-8d24-52b04c504680 was raw, converting to qcow2 {{(pid=87048) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:21 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb Sep 28 12:33:21 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:21 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-20d4be12-7180-44d9-a9f2-5c8eed4794ab" returned: 0 in 0.328s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-20d4be12-7180-44d9-a9f2-5c8eed4794ab" released by "delete_volume" :: held 0.954s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Created reservations ['337a8308-02ea-4ecf-9288-2044c6afa46a', '2ddad40e-6d3d-43b0-bb7c-73f6420bb1f5', '7387afb2-a6a3-4fff-92f6-f73a3647b3cd', '2127299b-48b2-4048-82aa-5e0925e6c17b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:21 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:21 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:22 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.322s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:22 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Deleted volume successfully. Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb" returned: 0 in 0.594s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e592858f-34f0-46d1-8d24-52b04c504680_qmcl85_wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:33:22 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:22 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb 1G Sep 28 12:33:22 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-6d6dc7d7-528b-4b9d-a8cf-2233a649e717-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-e263bffa-074f-4a47-9155-e4cb65147acf tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-20d4be12-7180-44d9-a9f2-5c8eed4794ab-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-6d6dc7d7-528b-4b9d-a8cf-2233a649e717-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-quobyte-6d6dc7d7-528b-4b9d-a8cf-2233a649e717" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-6d6dc7d7-528b-4b9d-a8cf-2233a649e717" acquired by "delete_volume" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffba7f0-1783-43cb-88bf-bff3c732a055]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:22 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 Sep 28 12:33:22 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:22 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb 1G" returned: 0 in 0.548s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Downloaded image e592858f-34f0-46d1-8d24-52b04c504680 ((None, [{'url': 'file:///opt/stack/data/glance/images/e592858f-34f0-46d1-8d24-52b04c504680', 'metadata': {}}])) to volume b4b650c4-0d84-4677-ae34-28c41cefb9fb successfully. {{(pid=87048) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Temporary image e592858f-34f0-46d1-8d24-52b04c504680 for user 478c1de4deea46ebbcfd1c7a67a3f4df is deleted. {{(pid=87048) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.volume.volume_utils [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Marking volume b4b650c4-0d84-4677-ae34-28c41cefb9fb as bootable. {{(pid=87048) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Copying metadata from image e592858f-34f0-46d1-8d24-52b04c504680 to b4b650c4-0d84-4677-ae34-28c41cefb9fb. {{(pid=87048) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Creating volume glance metadata for volume b4b650c4-0d84-4677-ae34-28c41cefb9fb backed by image e592858f-34f0-46d1-8d24-52b04c504680 with: {'image_id': 'e592858f-34f0-46d1-8d24-52b04c504680', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c871d8067cd7135417bea9a31e301b7e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87048) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc537829-17ac-404f-853a-bcf051ce3d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb', 'volume_size': 1, 'image_id': 'e592858f-34f0-46d1-8d24-52b04c504680', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e592858f-34f0-46d1-8d24-52b04c504680', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c871d8067cd7135417bea9a31e301b7e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '091ab479e72d44d28f6deac13371acb5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '24b82498dbe00ea046c1d42b04b1f1a6eb657c51c7c183119d7328365be128649ec4ee489b6730d88ca7e8f4e2f06504c467a4df39dbc698f2e2c8e1e94902f4', 'id': 'e592858f-34f0-46d1-8d24-52b04c504680', 'created_at': datetime.datetime(2026, 9, 28, 10, 33, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 10, 33, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e592858f-34f0-46d1-8d24-52b04c504680/file', 'properties': {}}, 'image_service': }' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f6ad38-d2ea-41ad-9d9a-cb6c4f26d5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:22 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Volume volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb (b4b650c4-0d84-4677-ae34-28c41cefb9fb): created successfully Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f6ad38-d2ea-41ad-9d9a-cb6c4f26d5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Flow 'volume_create_manager' (aa7b71c5-63b1-47ed-be95-aa31bc487928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-35a58de3-7529-4fd7-98e6-f34280183b79 tempest-VolumeImageDependencyTests-1522846126 None] Created volume successfully. Sep 28 12:33:22 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717" returned: 0 in 0.524s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:22 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717 Sep 28 12:33:22 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:23 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-6d6dc7d7-528b-4b9d-a8cf-2233a649e717" returned: 0 in 0.292s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-6d6dc7d7-528b-4b9d-a8cf-2233a649e717" released by "delete_volume" :: held 0.870s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Created reservations ['b31e935a-c505-4d54-b8f6-a71df19af4cc', '7ee34adf-1969-4e86-bd78-1e4644bcb0e5', '9455c0a7-a946-47c2-88c1-f39fb83c5504', 'b68e3131-8266-4841-9944-01cab3efb07f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:23 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:23 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-70d93436-1f4a-4aac-918b-770edd5b7f32-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-70d93436-1f4a-4aac-918b-770edd5b7f32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-quobyte-17cf580f-751d-427a-b0b1-fa5c60da8f3f" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-17cf580f-751d-427a-b0b1-fa5c60da8f3f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-quobyte-70d93436-1f4a-4aac-918b-770edd5b7f32" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-70d93436-1f4a-4aac-918b-770edd5b7f32" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Deleting offline snapshot 70d93436-1f4a-4aac-918b-770edd5b7f32 of volume 17cf580f-751d-427a-b0b1-fa5c60da8f3f {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] snapshot_file for this snap is: volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7dd323-e3bc-4045-9f1f-43a4f0e7892b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Flow 'volume_create_manager' (43c4c8b9-bac6-47ea-9767-9619e070f5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:23 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 Sep 28 12:33:23 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7344a0-6e07-42e3-9055-a154eb1ae245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Acquiring lock "cinder-b4b650c4-0d84-4677-ae34-28c41cefb9fb-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:23 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.479s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7344a0-6e07-42e3-9055-a154eb1ae245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192868338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f98b60-d67c-47bd-9799-85020f6396ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22f2f19bf7a48d18f5400f0be401517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:24Z,use_quota=True,user_id='310e9737c83b4bddade2857236632df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c6cded-cee7-4330-9d44-5a5cbb7e6a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04c6cded-cee7-4330-9d44-5a5cbb7e6a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c410220-94b0-4c31-b8c2-b213e106822f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c410220-94b0-4c31-b8c2-b213e106822f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f98b60-d67c-47bd-9799-85020f6396ec', 'volume_name': 'volume-31f98b60-d67c-47bd-9799-85020f6396ec', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d0ffca-b705-4d58-b7b2-75819c52c9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47d0ffca-b705-4d58-b7b2-75819c52c9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e05ab5-ede9-40d5-b169-ad6f8e6d5a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:23 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Volume 31f98b60-d67c-47bd-9799-85020f6396ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f98b60-d67c-47bd-9799-85020f6396ec', 'volume_size': 1} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192868338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f98b60-d67c-47bd-9799-85020f6396ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22f2f19bf7a48d18f5400f0be401517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:24Z,use_quota=True,user_id='310e9737c83b4bddade2857236632df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Creating volume 31f98b60-d67c-47bd-9799-85020f6396ec {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:23 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:23 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Deleted volume successfully. Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Lock "cinder-b4b650c4-0d84-4677-ae34-28c41cefb9fb-delete_volume" acquired by "delete_volume" :: waited 0.119s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:23 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec 1073741824 Sep 28 12:33:23 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5a5a3675-e791-4793-ade1-c57fdef6231f tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-6d6dc7d7-528b-4b9d-a8cf-2233a649e717-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Acquiring lock "cinder-quobyte-b4b650c4-0d84-4677-ae34-28c41cefb9fb" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Lock "cinder-quobyte-b4b650c4-0d84-4677-ae34-28c41cefb9fb" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ef0c51-2d9a-4995-b72a-5fe3422ace94]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:24 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32" returned: 0 in 0.484s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e5735c-77e3-468b-9478-8cb2f1b7042b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:24 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb Sep 28 12:33:24 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:24 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f Sep 28 12:33:24 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:24 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb" returned: 0 in 0.576s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:24 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec 1073741824" returned: 0 in 0.756s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:24 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb Sep 28 12:33:24 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:24 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec Sep 28 12:33:24 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:24 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f" returned: 0 in 0.533s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:24 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 Sep 28 12:33:24 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:24 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-b4b650c4-0d84-4677-ae34-28c41cefb9fb" returned: 0 in 0.352s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:24 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Lock "cinder-quobyte-b4b650c4-0d84-4677-ae34-28c41cefb9fb" released by "delete_volume" :: held 1.005s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec" returned: 0 in 0.322s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e05ab5-ede9-40d5-b169-ad6f8e6d5a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f98b60-d67c-47bd-9799-85020f6396ec', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:24 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5966c3-ffc2-4927-ab25-c1a74fcb4c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:25 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Volume volume-31f98b60-d67c-47bd-9799-85020f6396ec (31f98b60-d67c-47bd-9799-85020f6396ec): created successfully Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac5966c3-ffc2-4927-ab25-c1a74fcb4c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Flow 'volume_create_manager' (43c4c8b9-bac6-47ea-9767-9619e070f5c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:25 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-237e902c-0bb8-4f9d-bf58-d44a872b6913 tempest-ProjectReaderTests-1988698260 None] Created volume successfully. Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Created reservations ['fd00ce1b-0629-47f5-a877-dfac13a38c14', '03e421d8-abf3-42b2-b0ea-a002bf0ad3c8', '1ee901fc-7ca9-4f2e-876a-d312fdf2d5b5', '56154a06-8ba8-432f-a1fc-d54c1cbcb3d8'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:25 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:25 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:25 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32" returned: 0 in 0.545s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:25 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32 Sep 28 12:33:25 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:25 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.299s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:25 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Deleted volume successfully. Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2831c9d6-46f3-49c9-9568-540bd7e47dd5 tempest-VolumeImageDependencyTests-1522846126 None] Lock "cinder-b4b650c4-0d84-4677-ae34-28c41cefb9fb-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:25 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f.70d93436-1f4a-4aac-918b-770edd5b7f32" returned: 0 in 0.323s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-70d93436-1f4a-4aac-918b-770edd5b7f32" released by "_delete_snapshot" :: held 2.127s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-17cf580f-751d-427a-b0b1-fa5c60da8f3f" released by "delete_snapshot" :: held 2.186s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Created reservations ['fb490921-b513-4779-ac95-e755c04e6af0', '7a5f2bf0-e861-471a-8940-f73f462140fa', 'af9e09d9-16f8-43d2-b182-134925a5d9b9', 'ad3c7ab4-5b1f-40ec-99ad-db95beddebf1'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:25 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Delete snapshot completed successfully. Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-18e7e1f8-0593-4533-a763-3ba745015010 tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-70d93436-1f4a-4aac-918b-770edd5b7f32-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "cinder-31f98b60-d67c-47bd-9799-85020f6396ec-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Lock "cinder-31f98b60-d67c-47bd-9799-85020f6396ec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "cinder-quobyte-31f98b60-d67c-47bd-9799-85020f6396ec" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Lock "cinder-quobyte-31f98b60-d67c-47bd-9799-85020f6396ec" acquired by "delete_volume" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e010e61-6e11-44e0-9fc3-9526582141b1]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:26 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec Sep 28 12:33:26 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-17cf580f-751d-427a-b0b1-fa5c60da8f3f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:26 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec" returned: 0 in 0.594s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-17cf580f-751d-427a-b0b1-fa5c60da8f3f-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:26 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec Sep 28 12:33:26 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "cinder-quobyte-17cf580f-751d-427a-b0b1-fa5c60da8f3f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-17cf580f-751d-427a-b0b1-fa5c60da8f3f" acquired by "delete_volume" :: waited 0.039s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a11b97f-f811-4ade-ba4c-9ec0ad4d86fb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:27 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-31f98b60-d67c-47bd-9799-85020f6396ec" returned: 0 in 0.374s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Lock "cinder-quobyte-31f98b60-d67c-47bd-9799-85020f6396ec" released by "delete_volume" :: held 1.049s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:27 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f Sep 28 12:33:27 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Created reservations ['8f05da26-387f-4176-998e-44d83347f0ad', 'd70545ee-9cb6-4148-b386-083d5573f042', 'd60bb4e2-46bf-4148-9c36-29c097767a12', 'ff7c81b4-ccc6-4691-99ef-248f4a00660b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:27 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:27 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:27 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f" returned: 0 in 0.518s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:27 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f Sep 28 12:33:27 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:27 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.405s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Deleted volume successfully. Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-678ba9d5-b331-4ff2-b5d6-091edad82c03 tempest-ProjectReaderTests-1988698260 None] Lock "cinder-31f98b60-d67c-47bd-9799-85020f6396ec-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:27 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-17cf580f-751d-427a-b0b1-fa5c60da8f3f" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-quobyte-17cf580f-751d-427a-b0b1-fa5c60da8f3f" released by "delete_volume" :: held 1.015s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:27 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Created reservations ['45187fa1-886d-4f55-8283-cd75b7b7c0b1', '4634ae37-7281-4513-9981-9f2503ddac30', '1414d5c2-b112-47f6-98e3-b1e98fce48e1', '153c810f-6448-49b3-a871-1f1b9c59efb6'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:28 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:28 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:28 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.295s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:28 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Deleted volume successfully. Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c1558eb7-b892-46f7-8eb5-54305433c58e tempest-CreateVolumesFromSnapshotTest-142651388 None] Lock "cinder-17cf580f-751d-427a-b0b1-fa5c60da8f3f-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Flow 'volume_create_manager' (f7c19027-4fb1-4f9d-90ad-34fe5dfd3978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010b31d3-a44a-4f7f-86f5-bd168de0d42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010b31d3-a44a-4f7f-86f5-bd168de0d42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697313288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028c5b72-3dfc-4259-a677-a0e6f508a4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22f2f19bf7a48d18f5400f0be401517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:29Z,use_quota=True,user_id='310e9737c83b4bddade2857236632df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb67460-1dd7-48f2-a3fe-83d17541942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abb67460-1dd7-48f2-a3fe-83d17541942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f31d3b-a91d-4af8-9cbb-a340f2805750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f31d3b-a91d-4af8-9cbb-a340f2805750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '028c5b72-3dfc-4259-a677-a0e6f508a4c3', 'volume_name': 'volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339f132e-185b-41b9-afdc-96da69bda359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:28 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339f132e-185b-41b9-afdc-96da69bda359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f3a24f-f6b7-44cd-8746-3e5866434d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:29 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Volume 028c5b72-3dfc-4259-a677-a0e6f508a4c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3', 'volume_size': 1} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-697313288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=028c5b72-3dfc-4259-a677-a0e6f508a4c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b22f2f19bf7a48d18f5400f0be401517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:29Z,use_quota=True,user_id='310e9737c83b4bddade2857236632df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Creating volume 028c5b72-3dfc-4259-a677-a0e6f508a4c3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:29 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:29 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 1073741824 Sep 28 12:33:29 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:29 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 1073741824" returned: 0 in 0.662s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:29 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 Sep 28 12:33:29 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:30 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3" returned: 0 in 0.399s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] <== create_volume: return (1145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.147s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:30 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f3a24f-f6b7-44cd-8746-3e5866434d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:30 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a943f70-bbe9-4747-9f6d-c0ef40fb02bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:30 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Volume volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 (028c5b72-3dfc-4259-a677-a0e6f508a4c3): created successfully Sep 28 12:33:30 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a943f70-bbe9-4747-9f6d-c0ef40fb02bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:30 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Flow 'volume_create_manager' (f7c19027-4fb1-4f9d-90ad-34fe5dfd3978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:30 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3c3c8c0b-e647-43ab-b3ae-1d91a208ab69 tempest-ProjectReaderTests-1988698260 None] Created volume successfully. Sep 28 12:33:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "cinder-028c5b72-3dfc-4259-a677-a0e6f508a4c3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Lock "cinder-028c5b72-3dfc-4259-a677-a0e6f508a4c3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "cinder-quobyte-028c5b72-3dfc-4259-a677-a0e6f508a4c3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Lock "cinder-quobyte-028c5b72-3dfc-4259-a677-a0e6f508a4c3" acquired by "delete_volume" :: waited 0.022s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:31 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c494abad-6dc7-4ec2-b48a-a82ec98a3c75]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:31 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 Sep 28 12:33:31 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:31 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5eb54ff9-2ced-4779-a1dd-6ba03a97422d tempest-ProjectAdminTests-1890361321 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.2088623046875, 'free_capacity_gb': 1775.2088623046875, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87048) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 12:33:31 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3" returned: 0 in 0.480s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:31 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3 Sep 28 12:33:31 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:32 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-028c5b72-3dfc-4259-a677-a0e6f508a4c3" returned: 0 in 0.397s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Lock "cinder-quobyte-028c5b72-3dfc-4259-a677-a0e6f508a4c3" released by "delete_volume" :: held 0.931s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=257,cinder:SELECT=184,cinder:INSERT=70,cinder:DELETE=26 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=195,cinder:UPDATE=269,cinder:INSERT=70,cinder:DELETE=21 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Created reservations ['8579ef94-7c84-44e9-8c88-c2a12bc11e39', 'c755f716-74d5-4bcf-a966-75cb9cd2ee97', 'be667941-4b79-463f-bbdc-04a795869acd', 'd1a7dbdb-bb70-4e8a-bb57-a2459a18d335'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:32 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:32 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:32 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.324s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:32 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Deleted volume successfully. Sep 28 12:33:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-06e2c885-3fff-4e8e-b16b-9a2b7500f657 tempest-ProjectReaderTests-1988698260 None] Lock "cinder-028c5b72-3dfc-4259-a677-a0e6f508a4c3-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Flow 'volume_create_manager' (448da732-9f07-4245-8ef5-9d45cac8d0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd21d88-c22d-426a-984e-345015c8c3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dd21d88-c22d-426a-984e-345015c8c3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d088d4e6544c49fc9c50ef8372993821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:34Z,use_quota=True,user_id='fc54f7d33147446b88f1e36bcf932057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9d391d-0df3-44a3-a54e-abfc6c7cbe92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da9d391d-0df3-44a3-a54e-abfc6c7cbe92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e864535e-9330-4e59-9d2b-5298692fe834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e864535e-9330-4e59-9d2b-5298692fe834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2', 'volume_name': 'volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5e8cce-81ce-4abd-bb0c-fccdb7bef4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5e8cce-81ce-4abd-bb0c-fccdb7bef4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5a814-d0b7-4481-be26-681da71a655e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:33 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Volume d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2', 'volume_size': 1} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d088d4e6544c49fc9c50ef8372993821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:34Z,use_quota=True,user_id='fc54f7d33147446b88f1e36bcf932057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Creating volume d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:33 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:33 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 1073741824 Sep 28 12:33:33 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:34 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 1073741824" returned: 0 in 0.647s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:34 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 Sep 28 12:33:34 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:34 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2" returned: 0 in 0.368s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edd5a814-d0b7-4481-be26-681da71a655e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d434bec-1368-42ed-b5a9-642e39541cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:34 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Volume volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 (d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2): created successfully Sep 28 12:33:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d434bec-1368-42ed-b5a9-642e39541cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Flow 'volume_create_manager' (448da732-9f07-4245-8ef5-9d45cac8d0e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8e42727c-8f83-451d-a370-8822be55a689 tempest-CinderUnicodeTest-1385242745 None] Created volume successfully. Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Flow 'volume_create_manager' (ae162346-abcc-46d2-bc14-2b081acb720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d07175-e47c-4745-8402-231e72047956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d07175-e47c-4745-8402-231e72047956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1196040506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d739aae-95be-4518-9e3d-38882a9991fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d088d4e6544c49fc9c50ef8372993821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:37Z,use_quota=True,user_id='fc54f7d33147446b88f1e36bcf932057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ffcda8-b4a1-4344-99cc-c95c7e661c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63ffcda8-b4a1-4344-99cc-c95c7e661c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e329112-4d30-457b-8501-e08b6f1e5e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e329112-4d30-457b-8501-e08b6f1e5e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d739aae-95be-4518-9e3d-38882a9991fd', 'volume_name': 'volume-2d739aae-95be-4518-9e3d-38882a9991fd', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673c39e2-13ee-441c-8948-0c986ad1ac96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (673c39e2-13ee-441c-8948-0c986ad1ac96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017199af-ec7e-4001-86c7-f7f51dc088d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:36 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Volume 2d739aae-95be-4518-9e3d-38882a9991fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d739aae-95be-4518-9e3d-38882a9991fd', 'volume_size': 1} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1196040506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d739aae-95be-4518-9e3d-38882a9991fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d088d4e6544c49fc9c50ef8372993821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:37Z,use_quota=True,user_id='fc54f7d33147446b88f1e36bcf932057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Creating volume 2d739aae-95be-4518-9e3d-38882a9991fd {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:36 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:36 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd 1073741824 Sep 28 12:33:36 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (68dc5268-6cb2-4407-995b-38ba52337b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dda6535-83a8-4cd2-a53f-8cb0da420edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dda6535-83a8-4cd2-a53f-8cb0da420edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-681398339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d5f4a1-ebf1-4c49-9b0d-320f0315330d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:37Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b69b1d-657c-436b-82cc-116b2d6350c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5b69b1d-657c-436b-82cc-116b2d6350c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5e407c-580b-4ff5-99fa-0eaf69ca0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5e407c-580b-4ff5-99fa-0eaf69ca0381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d5f4a1-ebf1-4c49-9b0d-320f0315330d', 'volume_name': 'volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68b4e64-d433-497b-96b3-45362bb01210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68b4e64-d433-497b-96b3-45362bb01210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f701e5-119d-4b03-aa68-8e0741353832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:37 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Volume f9d5f4a1-ebf1-4c49-9b0d-320f0315330d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d', 'volume_size': 1} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:37 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd 1073741824" returned: 0 in 0.601s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:37 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd Sep 28 12:33:37 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:37 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd" returned: 0 in 0.384s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.554s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-681398339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d5f4a1-ebf1-4c49-9b0d-320f0315330d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:37Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Creating volume f9d5f4a1-ebf1-4c49-9b0d-320f0315330d {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:37 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (017199af-ec7e-4001-86c7-f7f51dc088d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d739aae-95be-4518-9e3d-38882a9991fd', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69a2a77-eabd-4498-ba21-6e1dc05e8a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:37 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d 1073741824 Sep 28 12:33:37 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:37 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Volume volume-2d739aae-95be-4518-9e3d-38882a9991fd (2d739aae-95be-4518-9e3d-38882a9991fd): created successfully Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69a2a77-eabd-4498-ba21-6e1dc05e8a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:37 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Flow 'volume_create_manager' (ae162346-abcc-46d2-bc14-2b081acb720b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:37 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-bb075841-d6c7-4bd3-9267-ca12dc4c61f1 tempest-CinderUnicodeTest-1385242745 None] Created volume successfully. Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:38 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:38 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:38 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d 1073741824" returned: 0 in 0.651s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:38 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d Sep 28 12:33:38 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:38 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.380s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:33:38 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" returned: 0 in 0.298s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51f701e5-119d-4b03-aa68-8e0741353832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb056b08-5e2a-4567-b35a-c7d7b418a2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:38 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Volume volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d (f9d5f4a1-ebf1-4c49-9b0d-320f0315330d): created successfully Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb056b08-5e2a-4567-b35a-c7d7b418a2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (68dc5268-6cb2-4407-995b-38ba52337b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d38c1b11-430c-463d-a3ab-eb85a517e86e tempest-ProjectMemberTests-302829666 None] Created volume successfully. Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Creating offline snapshot e241685d-0a14-4dc7-a3be-9fc333838aeb of volume 2d739aae-95be-4518-9e3d-38882a9991fd {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Flow 'volume_create_manager' (4c72d5c8-4dd5-426d-9e2b-aa1647fd4203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ce03b4-94d6-48b7-87f8-95b5549d1d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8f66cf-83e4-4859-8a5f-fab703414ab3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ce03b4-94d6-48b7-87f8-95b5549d1d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429643162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6ab3b9-a9a5-4fcb-acd6-95370d295b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647af39d810241409750a3ef6fdeb224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:39Z,use_quota=True,user_id='a91751c0df4d4664adc823988999045c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27a9226-1ea8-455e-a69d-94feb5fe875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27a9226-1ea8-455e-a69d-94feb5fe875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f25ac77-f031-4e03-bde2-38caf8c3e8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f25ac77-f031-4e03-bde2-38caf8c3e8e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6ab3b9-a9a5-4fcb-acd6-95370d295b91', 'volume_name': 'volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9a655d-e722-4a4f-abdb-35ee5cf873a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff9a655d-e722-4a4f-abdb-35ee5cf873a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422a19a3-4895-4f49-9b41-a11354e5efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:39 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Volume 2d6ab3b9-a9a5-4fcb-acd6-95370d295b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91', 'volume_size': 1} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:39 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd Sep 28 12:33:39 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:39 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd" returned: 0 in 0.496s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:40 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb 1G Sep 28 12:33:40 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:40 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb 1G" returned: 0 in 0.495s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d739aae-95be-4518-9e3d-38882a9991fd -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:40 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d739aae-95be-4518-9e3d-38882a9991fd -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb Sep 28 12:33:40 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:40 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d739aae-95be-4518-9e3d-38882a9991fd -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb" returned: 0 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:40 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb is being set with open permissions: ugo+rw Sep 28 12:33:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:40 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb Sep 28 12:33:40 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:41 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb" returned: 0 in 0.291s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:41 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.info Sep 28 12:33:41 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:41 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.info" returned: 0 in 0.295s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:41 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.info is being set with open permissions: ugo+rw Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:41 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.info Sep 28 12:33:41 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:41 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.info" returned: 0 in 0.261s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.380s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.205s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1429643162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6ab3b9-a9a5-4fcb-acd6-95370d295b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647af39d810241409750a3ef6fdeb224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:39Z,use_quota=True,user_id='a91751c0df4d4664adc823988999045c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Creating volume 2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:41 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:41 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 1073741824 Sep 28 12:33:41 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:41 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9c2d7875-25ed-4a44-b7f0-3a65d7c41394 tempest-CinderUnicodeTest-1385242745 None] Create snapshot completed successfully Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "cinder-e241685d-0a14-4dc7-a3be-9fc333838aeb-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:42 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 1073741824" returned: 0 in 0.549s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-e241685d-0a14-4dc7-a3be-9fc333838aeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "cinder-quobyte-2d739aae-95be-4518-9e3d-38882a9991fd" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-quobyte-2d739aae-95be-4518-9e3d-38882a9991fd" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "cinder-quobyte-e241685d-0a14-4dc7-a3be-9fc333838aeb" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-quobyte-e241685d-0a14-4dc7-a3be-9fc333838aeb" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Deleting offline snapshot e241685d-0a14-4dc7-a3be-9fc333838aeb of volume 2d739aae-95be-4518-9e3d-38882a9991fd {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:33:42 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 Sep 28 12:33:42 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] snapshot_file for this snap is: volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a736dac1-fa3b-44a8-a7ec-076baf07141d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:42 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb Sep 28 12:33:42 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:42 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.035s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (422a19a3-4895-4f49-9b41-a11354e5efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b332eb72-b60f-40e6-a2b2-980023bb5c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Creating offline snapshot 721aa743-7d76-4fc2-a573-65f7c47b095a of volume f9d5f4a1-ebf1-4c49-9b0d-320f0315330d {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:33:42 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Volume volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 (2d6ab3b9-a9a5-4fcb-acd6-95370d295b91): created successfully Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b332eb72-b60f-40e6-a2b2-980023bb5c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Flow 'volume_create_manager' (4c72d5c8-4dd5-426d-9e2b-aa1647fd4203) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b89eff-9ca4-45d1-bdf7-3a1d44e8c0cf]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:42 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5ba1d196-5a27-43e4-8d0d-06e642a453fb tempest-ProjectReaderTests-1647842222 None] Created volume successfully. Sep 28 12:33:42 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb" returned: 0 in 0.481s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d739aae-95be-4518-9e3d-38882a9991fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:33:42 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d Sep 28 12:33:42 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9366e56f-8757-4660-9a9c-ac59370e0168]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:43 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd Sep 28 12:33:43 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:43 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" returned: 0 in 0.534s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:43 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a 1G Sep 28 12:33:43 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:43 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd" returned: 0 in 0.604s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:43 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb Sep 28 12:33:43 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Acquiring lock "cinder-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:43 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Lock "cinder-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Acquiring lock "cinder-quobyte-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:44 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Lock "cinder-quobyte-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91" acquired by "delete_volume" :: waited 0.031s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a 1G" returned: 0 in 0.675s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09a1219-7f1f-4eb5-94f0-b4349c64f86e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:44 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a Sep 28 12:33:44 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:44 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb" returned: 0 in 0.519s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:44 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb Sep 28 12:33:44 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:44 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 Sep 28 12:33:44 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:44 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a" returned: 0 in 0.382s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:44 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a is being set with open permissions: ugo+rw Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:44 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd.e241685d-0a14-4dc7-a3be-9fc333838aeb" returned: 0 in 0.330s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:44 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a Sep 28 12:33:44 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-quobyte-e241685d-0a14-4dc7-a3be-9fc333838aeb" released by "_delete_snapshot" :: held 2.109s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:44 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91" returned: 0 in 0.472s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-quobyte-2d739aae-95be-4518-9e3d-38882a9991fd" released by "delete_snapshot" :: held 2.169s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:44 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91 Sep 28 12:33:44 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Created reservations ['466360e7-43f0-4302-a292-67ab5c9eb4f3', 'a0dd5661-687a-4b82-9419-8cb4879bc8eb', 'c786c764-f147-4810-a73f-e1949ec520f8', '9a6426d6-7538-4c07-b34f-5e7b6d55da1f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:44 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Delete snapshot completed successfully. Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ca25a2d4-e673-49ea-9823-d3dc2ce23027 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-e241685d-0a14-4dc7-a3be-9fc333838aeb-delete_snapshot" released by "delete_snapshot" :: held 2.357s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Flow 'volume_create_manager' (0967771a-e047-4b75-9ad1-15f40b9ed872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:44 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17e565e-ae49-44bd-b65f-4b53d2fc98d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a" returned: 0 in 0.341s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17e565e-ae49-44bd-b65f-4b53d2fc98d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2141894031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1dd5ea-6931-4832-bcd4-fb29b47d120f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b99ecc2ed62491b865340229c29bf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:45Z,use_quota=True,user_id='6b11c35fdab449119978bf5fa4a07f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9ddc9f-bffd-41a2-939a-ae9ede7a3a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e9ddc9f-bffd-41a2-939a-ae9ede7a3a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aa0f4d-9b14-4664-b374-7de04d6c1dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98aa0f4d-9b14-4664-b374-7de04d6c1dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee1dd5ea-6931-4832-bcd4-fb29b47d120f', 'volume_name': 'volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4270e053-6953-4046-be17-846711d26ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4270e053-6953-4046-be17-846711d26ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f887cac6-bb67-4d42-9a9f-cce2b66d1585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:44 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Volume ee1dd5ea-6931-4832-bcd4-fb29b47d120f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f', 'volume_size': 1} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:44 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91" returned: 0 in 0.303s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Lock "cinder-quobyte-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91" released by "delete_volume" :: held 0.839s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:44 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.info Sep 28 12:33:44 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:44 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Created reservations ['8fd5a62e-3d1c-4773-b6d5-cf0105f5d16f', '583e3a5d-e473-45d1-a2dc-581992c3ccf0', 'ce85398f-05d3-424a-bc54-e269ace6bba2', 'c4d7722f-fd3e-4759-bb59-79659a0f31a5'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:45 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:45 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:45 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.info" returned: 0 in 0.296s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:45 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.info is being set with open permissions: ugo+rw Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:45 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.info Sep 28 12:33:45 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:45 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Deleted volume successfully. Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-adc3f411-8ef0-4f99-84e6-09d1f0f5dab7 tempest-ProjectReaderTests-1647842222 None] Lock "cinder-2d6ab3b9-a9a5-4fcb-acd6-95370d295b91-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:45 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.info" returned: 0 in 0.269s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.637s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2141894031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee1dd5ea-6931-4832-bcd4-fb29b47d120f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b99ecc2ed62491b865340229c29bf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:45Z,use_quota=True,user_id='6b11c35fdab449119978bf5fa4a07f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Creating volume ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:45 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:45 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f 1073741824 Sep 28 12:33:45 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-10b51c17-5a51-4412-ae59-05369e620c13 tempest-ProjectMemberTests-302829666 None] Create snapshot completed successfully Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "cinder-2d739aae-95be-4518-9e3d-38882a9991fd-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-2d739aae-95be-4518-9e3d-38882a9991fd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Flow 'volume_create_manager' (31ee2e6a-9549-47e6-a7a6-8d5f78e43274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9becaa1e-817f-435b-ae75-1b3da9a7d412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9becaa1e-817f-435b-ae75-1b3da9a7d412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341497250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e500c4d6-81df-433a-96d1-6b5269ecdeba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647af39d810241409750a3ef6fdeb224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:46Z,use_quota=True,user_id='a91751c0df4d4664adc823988999045c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863a43f8-5523-4e3c-8f86-c298c95782bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (863a43f8-5523-4e3c-8f86-c298c95782bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef76854-9302-438a-9ecc-825378330b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cef76854-9302-438a-9ecc-825378330b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e500c4d6-81df-433a-96d1-6b5269ecdeba', 'volume_name': 'volume-e500c4d6-81df-433a-96d1-6b5269ecdeba', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4df0c5f-4aa3-4423-b949-f20e91833d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4df0c5f-4aa3-4423-b949-f20e91833d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c74831-c627-491c-9700-f5896f715c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:45 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Volume e500c4d6-81df-433a-96d1-6b5269ecdeba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e500c4d6-81df-433a-96d1-6b5269ecdeba', 'volume_size': 1} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "cinder-quobyte-2d739aae-95be-4518-9e3d-38882a9991fd" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-quobyte-2d739aae-95be-4518-9e3d-38882a9991fd" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca152638-6602-4298-8a88-b24bdac1b748]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:45 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd Sep 28 12:33:45 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:45 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f 1073741824" returned: 0 in 0.507s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:46 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f Sep 28 12:33:46 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-721aa743-7d76-4fc2-a573-65f7c47b095a-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Lock "cinder-721aa743-7d76-4fc2-a573-65f7c47b095a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-721aa743-7d76-4fc2-a573-65f7c47b095a" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-721aa743-7d76-4fc2-a573-65f7c47b095a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Deleting offline snapshot 721aa743-7d76-4fc2-a573-65f7c47b095a of volume f9d5f4a1-ebf1-4c49-9b0d-320f0315330d {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] snapshot_file for this snap is: volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb21b4-6bf1-419d-90bb-bdcca6f00517]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:46 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd" returned: 0 in 0.429s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:46 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd Sep 28 12:33:46 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:46 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" returned: 0 in 0.288s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.584s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341497250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e500c4d6-81df-433a-96d1-6b5269ecdeba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647af39d810241409750a3ef6fdeb224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:46Z,use_quota=True,user_id='a91751c0df4d4664adc823988999045c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Creating volume e500c4d6-81df-433a-96d1-6b5269ecdeba {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:46 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:46 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a Sep 28 12:33:46 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f887cac6-bb67-4d42-9a9f-cce2b66d1585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba 1073741824 Sep 28 12:33:46 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeda7f48-93fd-4617-a455-d6f698bd812d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:46 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Volume volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f (ee1dd5ea-6931-4832-bcd4-fb29b47d120f): created successfully Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeda7f48-93fd-4617-a455-d6f698bd812d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Flow 'volume_create_manager' (0967771a-e047-4b75-9ad1-15f40b9ed872) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:46 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d77f6e94-9f5b-4b57-9766-7cc52e40c7d9 tempest-SnapshotDependencyTests-513463025 None] Created volume successfully. Sep 28 12:33:46 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-2d739aae-95be-4518-9e3d-38882a9991fd" returned: 0 in 0.292s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-quobyte-2d739aae-95be-4518-9e3d-38882a9991fd" released by "delete_volume" :: held 0.791s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Created reservations ['7eae3d92-88b3-42f8-995a-e117209a2bd0', '5ff3a5b9-c8e1-4190-ab3c-9977a1204cb7', 'c0f69b89-b286-42d3-8779-8f5fdbbd6a78', '72ea5bde-8996-4777-8b08-40de12718685'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:46 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a" returned: 0 in 0.467s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e70305-88f2-49ca-aa2f-9c95ec83cf65]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:46 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:46 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:46 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d Sep 28 12:33:46 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "cinder-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:46 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba 1073741824" returned: 0 in 0.601s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "cinder-quobyte-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-quobyte-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2" acquired by "delete_volume" :: waited 0.033s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:47 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba Sep 28 12:33:47 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3e017e-b211-4d19-95dd-4cc8b25677e7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:47 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.422s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:47 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Deleted volume successfully. Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0d7dabcd-f956-4d09-840b-a9482d99bc70 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-2d739aae-95be-4518-9e3d-38882a9991fd-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:47 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 Sep 28 12:33:47 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:47 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" returned: 0 in 0.654s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:47 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a Sep 28 12:33:47 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:47 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba" returned: 0 in 0.426s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.116s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6c74831-c627-491c-9700-f5896f715c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e500c4d6-81df-433a-96d1-6b5269ecdeba', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efffa522-408a-4bc1-ac73-dd4ba6dc9535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:47 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Volume volume-e500c4d6-81df-433a-96d1-6b5269ecdeba (e500c4d6-81df-433a-96d1-6b5269ecdeba): created successfully Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efffa522-408a-4bc1-ac73-dd4ba6dc9535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Flow 'volume_create_manager' (31ee2e6a-9549-47e6-a7a6-8d5f78e43274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Creating offline snapshot 7364a7aa-4eec-4edf-850a-145d69725862 of volume ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:33:47 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-43b0c3b0-06cf-4337-b0a2-f266f7344425 tempest-ProjectReaderTests-1647842222 None] Created volume successfully. Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b800229-cd10-4a53-ac93-0310efe7a7be]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:47 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2" returned: 0 in 0.448s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:47 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2 Sep 28 12:33:47 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:47 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f Sep 28 12:33:47 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:47 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Acquiring lock "cinder-e500c4d6-81df-433a-96d1-6b5269ecdeba-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a" returned: 0 in 0.443s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Lock "cinder-e500c4d6-81df-433a-96d1-6b5269ecdeba-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:47 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:47 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a Sep 28 12:33:47 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2" returned: 0 in 0.295s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-quobyte-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2" released by "delete_volume" :: held 0.822s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Acquiring lock "cinder-quobyte-e500c4d6-81df-433a-96d1-6b5269ecdeba" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Lock "cinder-quobyte-e500c4d6-81df-433a-96d1-6b5269ecdeba" acquired by "delete_volume" :: waited 0.026s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f31c7de-7980-45e4-a5df-45181973d289]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Created reservations ['88c21173-45c2-4187-ad81-c13e71f29ebb', 'e791c33d-67f3-418e-81be-45893bf1181d', '7b1bfd0e-19a0-4d48-8c42-e0c9ccacac9a', 'c34c6964-e9dc-47c4-8f13-425074830b1f'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:48 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" returned: 0 in 0.534s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:48 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 1G Sep 28 12:33:48 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:48 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:48 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba Sep 28 12:33:48 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d.721aa743-7d76-4fc2-a573-65f7c47b095a" returned: 0 in 0.339s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:48 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:48 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-721aa743-7d76-4fc2-a573-65f7c47b095a" released by "_delete_snapshot" :: held 2.072s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" released by "delete_snapshot" :: held 2.109s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Created reservations ['96e790f9-e6c5-48bb-843f-eb5e16adb607', '4f4bd2d7-3d15-4576-b1ff-340d58c8c081', 'e4fd2e53-13da-40b2-8a29-305d5ab3de09', '6fad5dcb-e146-4022-9a60-308ae909582d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Delete snapshot completed successfully. Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80d87901-8390-444a-9fc5-4609d88c7a6a tempest-ProjectMemberTests-302829666 None] Lock "cinder-721aa743-7d76-4fc2-a573-65f7c47b095a-delete_snapshot" released by "delete_snapshot" :: held 2.342s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:48 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.424s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Deleted volume successfully. Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67dec5de-9dda-453d-9e70-a72bc09e2172 tempest-CinderUnicodeTest-1385242745 None] Lock "cinder-d28c9a77-5cd4-4e2a-8b9a-5ccef5efa9e2-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:48 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba" returned: 0 in 0.624s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:48 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba Sep 28 12:33:48 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:48 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 1G" returned: 0 in 0.612s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:48 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 Sep 28 12:33:48 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:48 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-e500c4d6-81df-433a-96d1-6b5269ecdeba" returned: 0 in 0.282s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Lock "cinder-quobyte-e500c4d6-81df-433a-96d1-6b5269ecdeba" released by "delete_volume" :: held 0.976s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:48 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Created reservations ['a23fb255-3cc6-482e-a6c3-198ca674a52d', '7b453a20-54db-479f-9677-70803b1f7edd', 'c53ddb46-331f-4e18-8876-1fbc1e40db26', '3ba88820-59bd-4dbc-b871-58667ad39bde'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:49 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862" returned: 0 in 0.387s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:49 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 is being set with open permissions: ugo+rw Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:49 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 Sep 28 12:33:49 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:49 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:49 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:49 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.332s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:49 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Deleted volume successfully. Sep 28 12:33:49 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862" returned: 0 in 0.385s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Lock "cinder-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6efc25c9-15f4-47fe-97e4-0d4d09356f4c tempest-ProjectReaderTests-1647842222 None] Lock "cinder-e500c4d6-81df-433a-96d1-6b5269ecdeba-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" acquired by "delete_volume" :: waited 0.034s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:49 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.info Sep 28 12:33:49 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9394f97-1450-4607-a723-832e0de1aaeb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:49 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d Sep 28 12:33:49 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:49 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.info" returned: 0 in 0.312s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:49 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.info is being set with open permissions: ugo+rw Sep 28 12:33:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:49 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.info Sep 28 12:33:49 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:50 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" returned: 0 in 0.430s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:50 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d Sep 28 12:33:50 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:50 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.info" returned: 0 in 0.312s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.751s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:50 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-cfaf778b-ea12-4ab0-a93d-5edc9fd0d51c tempest-SnapshotDependencyTests-513463025 None] Create snapshot completed successfully Sep 28 12:33:50 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" returned: 0 in 0.302s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d" released by "delete_volume" :: held 0.812s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Created reservations ['4a80d0eb-14f3-4f09-a64b-3c19723bce9b', '708c07c8-4ff1-422c-af25-1170cc7c024e', '79f58131-403f-4458-921f-2b8fad330175', '94fe2c08-7d2d-4fb8-9052-e01daf2fd189'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:50 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:50 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Flow 'volume_create_manager' (5e3fdedc-533b-4985-bc2b-d2e43885bf35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a456b979-7cdd-4c3f-943d-2bcd95dc64b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a456b979-7cdd-4c3f-943d-2bcd95dc64b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094793925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46907b11-fbf4-4805-b9e3-898e40278d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647af39d810241409750a3ef6fdeb224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:51Z,use_quota=True,user_id='a91751c0df4d4664adc823988999045c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffbce6f-b263-48b1-9c82-75a1128ab5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffbce6f-b263-48b1-9c82-75a1128ab5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4340d6d-c79a-45e1-ba56-e7e80f791ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4340d6d-c79a-45e1-ba56-e7e80f791ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46907b11-fbf4-4805-b9e3-898e40278d6a', 'volume_name': 'volume-46907b11-fbf4-4805-b9e3-898e40278d6a', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c623ff9d-2422-4428-99fd-38995608a1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c623ff9d-2422-4428-99fd-38995608a1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84346b42-4d56-45ce-814c-76303202ef95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:50 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Volume 46907b11-fbf4-4805-b9e3-898e40278d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46907b11-fbf4-4805-b9e3-898e40278d6a', 'volume_size': 1} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094793925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46907b11-fbf4-4805-b9e3-898e40278d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647af39d810241409750a3ef6fdeb224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:51Z,use_quota=True,user_id='a91751c0df4d4664adc823988999045c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Creating volume 46907b11-fbf4-4805-b9e3-898e40278d6a {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:50 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:50 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a 1073741824 Sep 28 12:33:50 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:51 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.501s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:51 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Deleted volume successfully. Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d077493d-72fb-456b-81a5-51732fda0c1a tempest-ProjectMemberTests-302829666 None] Lock "cinder-f9d5f4a1-ebf1-4c49-9b0d-320f0315330d-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:51 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a 1073741824" returned: 0 in 0.726s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:51 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a Sep 28 12:33:51 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (f96278b0-e5f2-4367-a6eb-5e628039a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436f60dd-05f1-45fc-b3dd-3a0f3493bb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (436f60dd-05f1-45fc-b3dd-3a0f3493bb8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568976697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88524379-4736-46eb-89ad-f9cde0002d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:52Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef51abc4-6888-4811-ae95-b04cba8ad4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef51abc4-6888-4811-ae95-b04cba8ad4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d80a76b-bc89-4b52-819f-b921c5a28f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d80a76b-bc89-4b52-819f-b921c5a28f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88524379-4736-46eb-89ad-f9cde0002d49', 'volume_name': 'volume-88524379-4736-46eb-89ad-f9cde0002d49', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d90299d-6714-4ce2-8dd7-82c2192b1b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d90299d-6714-4ce2-8dd7-82c2192b1b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93c654f-88c3-466e-aa21-d3cf049996c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Volume 88524379-4736-46eb-89ad-f9cde0002d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88524379-4736-46eb-89ad-f9cde0002d49', 'volume_size': 1} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Flow 'volume_create_manager' (c7f97291-e4f2-4f81-b34f-1d1196079185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5729ea0a-2f07-40cb-957c-7185df9476f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5729ea0a-2f07-40cb-957c-7185df9476f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79505668-ca0a-4a7c-a610-b4ba0e3540d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b99ecc2ed62491b865340229c29bf72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7364a7aa-4eec-4edf-850a-145d69725862,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:52Z,use_quota=True,user_id='6b11c35fdab449119978bf5fa4a07f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a14650-05e7-4a7a-9cf0-b768bcd9fcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3a14650-05e7-4a7a-9cf0-b768bcd9fcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf91470-3f87-4e44-8265-b5344dc0feeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf91470-3f87-4e44-8265-b5344dc0feeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '79505668-ca0a-4a7c-a610-b4ba0e3540d3', 'volume_name': 'volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3', 'volume_size': 1, 'snapshot_id': '7364a7aa-4eec-4edf-850a-145d69725862'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdbfb08-cccc-4ecb-b884-5e839d5100cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdbfb08-cccc-4ecb-b884-5e839d5100cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcda51f-d3e4-4478-8c19-7fe4912bee8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:51 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Volume 79505668-ca0a-4a7c-a610-b4ba0e3540d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3', 'volume_size': 1, 'snapshot_id': '7364a7aa-4eec-4edf-850a-145d69725862'} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a" returned: 0 in 0.326s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.089s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1568976697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88524379-4736-46eb-89ad-f9cde0002d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:52Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Creating volume 88524379-4736-46eb-89ad-f9cde0002d49 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:51 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:51 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84346b42-4d56-45ce-814c-76303202ef95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46907b11-fbf4-4805-b9e3-898e40278d6a', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 1073741824 Sep 28 12:33:52 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c21d87-6329-4f51-9db8-ba030580c525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:52 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Volume volume-46907b11-fbf4-4805-b9e3-898e40278d6a (46907b11-fbf4-4805-b9e3-898e40278d6a): created successfully Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c21d87-6329-4f51-9db8-ba030580c525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Flow 'volume_create_manager' (5e3fdedc-533b-4985-bc2b-d2e43885bf35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-167ac8ee-cb13-48e8-90c9-806731d478d3 tempest-ProjectReaderTests-1647842222 None] Created volume successfully. Sep 28 12:33:52 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 1073741824" returned: 0 in 0.492s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:52 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 Sep 28 12:33:52 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:52 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Acquiring lock "cinder-46907b11-fbf4-4805-b9e3-898e40278d6a-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49" returned: 0 in 0.283s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.791s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "cinder-quobyte-7364a7aa-4eec-4edf-850a-145d69725862-79505668-ca0a-4a7c-a610-b4ba0e3540d3" by "_create_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Lock "cinder-46907b11-fbf4-4805-b9e3-898e40278d6a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93c654f-88c3-466e-aa21-d3cf049996c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88524379-4736-46eb-89ad-f9cde0002d49', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71077b96-38c2-41a3-823f-fdb353e12c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-7364a7aa-4eec-4edf-850a-145d69725862-79505668-ca0a-4a7c-a610-b4ba0e3540d3" acquired by "_create_volume_from_snapshot" :: waited 0.046s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Creating volume 79505668-ca0a-4a7c-a610-b4ba0e3540d3 from snapshot 7364a7aa-4eec-4edf-850a-145d69725862 {{(pid=87048) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "cinder-quobyte-79505668-ca0a-4a7c-a610-b4ba0e3540d3" by "_copy_volume_from_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-79505668-ca0a-4a7c-a610-b4ba0e3540d3" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] snapshot: 7364a7aa-4eec-4edf-850a-145d69725862, volume: 79505668-ca0a-4a7c-a610-b4ba0e3540d3, {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 12:33:52 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Volume volume-88524379-4736-46eb-89ad-f9cde0002d49 (88524379-4736-46eb-89ad-f9cde0002d49): created successfully Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71077b96-38c2-41a3-823f-fdb353e12c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (f96278b0-e5f2-4367-a6eb-5e628039a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5927e532-b52f-4e6b-9fd7-ac958e73cc37 tempest-ProjectMemberTests-302829666 None] Created volume successfully. Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Acquiring lock "cinder-quobyte-46907b11-fbf4-4805-b9e3-898e40278d6a" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1cbab3-182e-4e91-baea-1051df7010d2]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Lock "cinder-quobyte-46907b11-fbf4-4805-b9e3-898e40278d6a" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d86bbf-1852-4502-964e-9f3c5f736664]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 Sep 28 12:33:53 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a Sep 28 12:33:53 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862" returned: 0 in 0.438s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d834e8-d974-4ad6-af03-e15b7843b692]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a" returned: 0 in 0.466s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a Sep 28 12:33:53 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f Sep 28 12:33:53 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:53 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-46907b11-fbf4-4805-b9e3-898e40278d6a" returned: 0 in 0.322s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Lock "cinder-quobyte-46907b11-fbf4-4805-b9e3-898e40278d6a" released by "delete_volume" :: held 0.836s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Created reservations ['a86f9335-dc5b-4bfe-839c-58206a4eba8e', '83b727b5-eb34-4519-b78c-88853df26cd3', 'c46abe96-5d08-484d-8465-375652631904', '103a7074-1421-496a-873d-b90c12c95898'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:33:53 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" returned: 0 in 0.496s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Creating direct copy from snapshot {{(pid=87048) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG cinder.utils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Path /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 not found in is_blk_device check {{(pid=87048) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:33:53 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:33:54 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 Sep 28 12:33:54 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:33:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:33:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:33:54 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:33:54 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:33:54 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 28 12:33:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.272s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:33:54 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:33:54 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Deleted volume successfully. Sep 28 12:33:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ba987591-86c2-4603-89d8-d3206752756d tempest-ProjectReaderTests-1647842222 None] Lock "cinder-46907b11-fbf4-4805-b9e3-898e40278d6a-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:33:55 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:33:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Flow 'volume_create_manager' (6c9eb6da-7eaa-45d3-b35f-40742a38945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:33:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8a65c6-05dc-41e7-911e-aea5534b4439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8a65c6-05dc-41e7-911e-aea5534b4439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720998580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54bb71a-deb1-4122-8045-e94ce8155e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647af39d810241409750a3ef6fdeb224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:56Z,use_quota=True,user_id='a91751c0df4d4664adc823988999045c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65362e45-4aef-4caf-8469-7508f5784143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65362e45-4aef-4caf-8469-7508f5784143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1da3ff-c45a-461e-9131-88aa37baf560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b1da3ff-c45a-461e-9131-88aa37baf560) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c54bb71a-deb1-4122-8045-e94ce8155e46', 'volume_name': 'volume-c54bb71a-deb1-4122-8045-e94ce8155e46', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc725b1b-fd17-45bf-88f6-1af6ab87d87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc725b1b-fd17-45bf-88f6-1af6ab87d87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:33:56 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09440787-7e4c-4d13-94a4-262015bef0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:33:56 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Volume c54bb71a-deb1-4122-8045-e94ce8155e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c54bb71a-deb1-4122-8045-e94ce8155e46', 'volume_size': 1} Sep 28 12:33:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:01 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3" returned: 0 in 7.059s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG cinder.image.image_utils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Image conversion details: src /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f, size 1024.00 MB, duration 7.06 sec, destination /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 {{(pid=87048) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 12:34:01 devstack cinder-volume[87048]: INFO cinder.image.image_utils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Converted 1024.00 MB image at 145.05 MB/s Sep 28 12:34:01 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 is being set with open permissions: ugo+rw Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 Sep 28 12:34:01 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:01 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3" returned: 0 in 0.256s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-79505668-ca0a-4a7c-a610-b4ba0e3540d3" released by "_copy_volume_from_snapshot" :: held 8.409s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-7364a7aa-4eec-4edf-850a-145d69725862-79505668-ca0a-4a7c-a610-b4ba0e3540d3" released by "_create_volume_from_snapshot" :: held 8.501s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.549s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.545s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Creating offline snapshot c47ae958-7724-4fce-a7b9-8a23053d138c of volume 88524379-4736-46eb-89ad-f9cde0002d49 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fcda51f-d3e4-4478-8c19-7fe4912bee8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3', 'volume_size': 1, 'snapshot_id': '7364a7aa-4eec-4edf-850a-145d69725862'}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68af13f-6820-4f47-b5a1-d96915c536e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c804c22c-c149-4d58-b879-6f5045fc7873]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Volume volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 (79505668-ca0a-4a7c-a610-b4ba0e3540d3): created successfully Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b68af13f-6820-4f47-b5a1-d96915c536e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Flow 'volume_create_manager' (c7f97291-e4f2-4f81-b34f-1d1196079185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-730a00c1-d376-4a87-8f4f-74ef42fffb60 tempest-SnapshotDependencyTests-513463025 None] Created volume successfully. Sep 28 12:34:01 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 Sep 28 12:34:01 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:01 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49" returned: 0 in 0.387s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:01 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c 1G Sep 28 12:34:01 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c 1G" returned: 0 in 0.406s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88524379-4736-46eb-89ad-f9cde0002d49 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88524379-4736-46eb-89ad-f9cde0002d49 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c Sep 28 12:34:02 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "cinder-7364a7aa-4eec-4edf-850a-145d69725862-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-7364a7aa-4eec-4edf-850a-145d69725862-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "cinder-quobyte-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "cinder-quobyte-7364a7aa-4eec-4edf-850a-145d69725862" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-7364a7aa-4eec-4edf-850a-145d69725862" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Deleting offline snapshot 7364a7aa-4eec-4edf-850a-145d69725862 of volume ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] snapshot_file for this snap is: volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cda523-129e-4da0-a723-667d94d68177]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88524379-4736-46eb-89ad-f9cde0002d49 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c" returned: 0 in 0.318s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c is being set with open permissions: ugo+rw Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c Sep 28 12:34:02 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 Sep 28 12:34:02 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c" returned: 0 in 0.240s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:02 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.info Sep 28 12:34:02 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:02 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862" returned: 0 in 0.371s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e94e5f1-2246-4b91-8398-b44ad9b9b464]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:02 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:03 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f Sep 28 12:34:03 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:03 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.info" returned: 0 in 0.275s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:03 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.info is being set with open permissions: ugo+rw Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:03 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.info Sep 28 12:34:03 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:03 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.info" returned: 0 in 0.277s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.293s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-720998580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c54bb71a-deb1-4122-8045-e94ce8155e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='647af39d810241409750a3ef6fdeb224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:33:56Z,use_quota=True,user_id='a91751c0df4d4664adc823988999045c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Creating volume c54bb71a-deb1-4122-8045-e94ce8155e46 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:03 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:03 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46 1073741824 Sep 28 12:34:03 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:03 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2e64dec6-c4c1-424d-9856-43e0a5445cb5 tempest-ProjectMemberTests-302829666 None] Create snapshot completed successfully Sep 28 12:34:03 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" returned: 0 in 0.613s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:03 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 Sep 28 12:34:03 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:03 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46 1073741824" returned: 0 in 0.499s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:03 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862" returned: 0 in 0.446s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:03 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:03 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46 Sep 28 12:34:03 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:03 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862 Sep 28 12:34:03 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:04 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46" returned: 0 in 0.256s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09440787-7e4c-4d13-94a4-262015bef0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c54bb71a-deb1-4122-8045-e94ce8155e46', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:04 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3684fe1a-f164-4a02-9a20-1155c7cb5dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f.7364a7aa-4eec-4edf-850a-145d69725862" returned: 0 in 0.269s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:04 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Volume volume-c54bb71a-deb1-4122-8045-e94ce8155e46 (c54bb71a-deb1-4122-8045-e94ce8155e46): created successfully Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3684fe1a-f164-4a02-9a20-1155c7cb5dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Flow 'volume_create_manager' (6c9eb6da-7eaa-45d3-b35f-40742a38945d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-7364a7aa-4eec-4edf-850a-145d69725862" released by "_delete_snapshot" :: held 1.828s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" released by "delete_snapshot" :: held 1.856s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-82d29f73-14ab-43b4-a43e-5343c9236101 tempest-ProjectReaderTests-1647842222 None] Created volume successfully. Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Created reservations ['ad2ab196-51af-41f9-a87c-04f9648e82eb', 'f51bf5c0-a53f-43be-992b-446442568cf6', '4b6d16e1-02bd-4834-9078-fd7b9e5545ad', '0947b732-2320-4a66-a57c-7626b127155d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-c47ae958-7724-4fce-a7b9-8a23053d138c-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:04 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Delete snapshot completed successfully. Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-8c9ec0a5-bba4-455b-8719-1c7fe2a733b0 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-7364a7aa-4eec-4edf-850a-145d69725862-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-c47ae958-7724-4fce-a7b9-8a23053d138c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-88524379-4736-46eb-89ad-f9cde0002d49" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-88524379-4736-46eb-89ad-f9cde0002d49" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-c47ae958-7724-4fce-a7b9-8a23053d138c" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-c47ae958-7724-4fce-a7b9-8a23053d138c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Deleting offline snapshot c47ae958-7724-4fce-a7b9-8a23053d138c of volume 88524379-4736-46eb-89ad-f9cde0002d49 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] snapshot_file for this snap is: volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db9fae-3e14-4bb0-a707-142a2a61c4ba]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Acquiring lock "cinder-c54bb71a-deb1-4122-8045-e94ce8155e46-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "cinder-ee1dd5ea-6931-4832-bcd4-fb29b47d120f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Lock "cinder-c54bb71a-deb1-4122-8045-e94ce8155e46-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-ee1dd5ea-6931-4832-bcd4-fb29b47d120f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Acquiring lock "cinder-quobyte-c54bb71a-deb1-4122-8045-e94ce8155e46" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "cinder-quobyte-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Lock "cinder-quobyte-c54bb71a-deb1-4122-8045-e94ce8155e46" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:04 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c Sep 28 12:34:04 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" acquired by "delete_volume" :: waited 0.029s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d02a96-53eb-4853-9cd0-783c7374aee3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc31354f-2b72-4b10-abf6-07cb32412ae6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:04 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:04 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46 Sep 28 12:34:04 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:04 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f Sep 28 12:34:04 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:05 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c" returned: 0 in 0.473s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88524379-4736-46eb-89ad-f9cde0002d49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[efba8ec2-be5b-4512-a8a6-f906027b7fca]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:05 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46" returned: 0 in 0.412s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:05 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46 Sep 28 12:34:05 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:05 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 Sep 28 12:34:05 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:05 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" returned: 0 in 0.468s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:05 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f Sep 28 12:34:05 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:05 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-c54bb71a-deb1-4122-8045-e94ce8155e46" returned: 0 in 0.297s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Lock "cinder-quobyte-c54bb71a-deb1-4122-8045-e94ce8155e46" released by "delete_volume" :: held 0.783s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:05 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49" returned: 0 in 0.495s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:05 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Created reservations ['44823835-5372-4100-a9a3-d2e2b9076ca1', 'cc1a73ac-f7fd-48a2-a6c9-2d3af16b9cf3', '318e6757-36bb-4eba-9007-c9aa2b6d4b1c', '6dcd61bc-90f6-46a6-8fec-8ccdfa13564d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:05 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c Sep 28 12:34:05 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-ee1dd5ea-6931-4832-bcd4-fb29b47d120f" released by "delete_volume" :: held 0.892s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:05 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:05 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Created reservations ['258da04d-4819-4ddb-8e2c-16a29d38ba22', '3d7951d2-6949-435f-928b-1aa58c25e751', '04d42346-c677-4e6d-af79-84635e6a2385', '493263e2-c040-4490-a30b-433df49c0d4d'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:06 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:06 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:06 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.464s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Deleted volume successfully. Sep 28 12:34:06 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c" returned: 0 in 0.693s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-82773084-fbd5-4a69-81a6-4ca29fd6804e tempest-ProjectReaderTests-1647842222 None] Lock "cinder-c54bb71a-deb1-4122-8045-e94ce8155e46-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:06 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c Sep 28 12:34:06 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:06 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.492s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Deleted volume successfully. Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2db110a8-d43f-4c90-ac62-5d99c5370777 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-ee1dd5ea-6931-4832-bcd4-fb29b47d120f-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:06 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49.c47ae958-7724-4fce-a7b9-8a23053d138c" returned: 0 in 0.338s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-c47ae958-7724-4fce-a7b9-8a23053d138c" released by "_delete_snapshot" :: held 2.142s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-88524379-4736-46eb-89ad-f9cde0002d49" released by "delete_snapshot" :: held 2.170s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Created reservations ['f8e39e97-acc7-4e79-be1e-d3ee53904a7b', '74bec7b5-c92e-4a32-b03e-1a290bb3b24a', '59ec207a-d0be-44b9-877c-451134026b7e', 'b32087a8-acac-44c5-8a9f-226ad2e10a65'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:06 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Delete snapshot completed successfully. Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-26c6fbdb-a6a2-41fa-a473-218dc7a858c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-c47ae958-7724-4fce-a7b9-8a23053d138c-delete_snapshot" released by "delete_snapshot" :: held 2.347s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "cinder-79505668-ca0a-4a7c-a610-b4ba0e3540d3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:06 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-79505668-ca0a-4a7c-a610-b4ba0e3540d3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "cinder-quobyte-79505668-ca0a-4a7c-a610-b4ba0e3540d3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-79505668-ca0a-4a7c-a610-b4ba0e3540d3" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f347e562-2324-43a6-8e5d-752844d14d05]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:07 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 Sep 28 12:34:07 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:07 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3" returned: 0 in 0.448s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:07 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3 Sep 28 12:34:07 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-88524379-4736-46eb-89ad-f9cde0002d49-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-88524379-4736-46eb-89ad-f9cde0002d49-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-88524379-4736-46eb-89ad-f9cde0002d49" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:07 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79505668-ca0a-4a7c-a610-b4ba0e3540d3" returned: 0 in 0.399s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-88524379-4736-46eb-89ad-f9cde0002d49" acquired by "delete_volume" :: waited 0.040s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-quobyte-79505668-ca0a-4a7c-a610-b4ba0e3540d3" released by "delete_volume" :: held 0.948s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5ccb4-5b71-4191-90eb-79455bce9fcb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Created reservations ['8d308c57-0a9c-4e0c-b7c3-21f8c4d16e73', '53628e94-3cde-494f-ac6c-9c0fc49c198e', '14fa047f-b894-4283-87d5-da2e073226be', '312cb72d-9bd3-4177-afe6-9edf1f41c083'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:08 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 Sep 28 12:34:08 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:08 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:08 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:08 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.319s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:08 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:08 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Deleted volume successfully. Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49" returned: 0 in 0.525s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:08 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49 Sep 28 12:34:08 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2a1c4f0f-12df-4f74-a2e1-36f7610628e8 tempest-SnapshotDependencyTests-513463025 None] Lock "cinder-79505668-ca0a-4a7c-a610-b4ba0e3540d3-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:08 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-88524379-4736-46eb-89ad-f9cde0002d49" returned: 0 in 0.250s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-88524379-4736-46eb-89ad-f9cde0002d49" released by "delete_volume" :: held 0.858s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Created reservations ['80694752-b9a4-4542-899a-d21c3b315446', '1a6d2e40-7eee-49c0-9f24-135ce8c68ec0', '960eaf92-36c2-4469-b2d4-709c31d5510c', 'da8a2bf0-4f46-4250-b665-e239c0e1c27c'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:08 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:08 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:09 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.258s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:09 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Deleted volume successfully. Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2ebe52e-8df0-4f0a-ae5c-a83d4ec055c2 tempest-ProjectMemberTests-302829666 None] Lock "cinder-88524379-4736-46eb-89ad-f9cde0002d49-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (17cbfa9d-fa2d-4782-b76f-c07126faf4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82669499-1e70-49c5-9dd7-0fa603747024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82669499-1e70-49c5-9dd7-0fa603747024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526562719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605ab4e6-c5ad-4a87-9976-88d75c94286b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:09Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117229e3-365d-4502-852c-68b0688d234b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117229e3-365d-4502-852c-68b0688d234b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53297e46-e8d8-4499-b80a-b30d43d7b0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53297e46-e8d8-4499-b80a-b30d43d7b0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605ab4e6-c5ad-4a87-9976-88d75c94286b', 'volume_name': 'volume-605ab4e6-c5ad-4a87-9976-88d75c94286b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c87315b-f26d-4f31-be8c-0521b28d723a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c87315b-f26d-4f31-be8c-0521b28d723a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b9f05b-b67a-4041-9c55-070fd4c6a305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:09 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Volume 605ab4e6-c5ad-4a87-9976-88d75c94286b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605ab4e6-c5ad-4a87-9976-88d75c94286b', 'volume_size': 1} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-526562719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605ab4e6-c5ad-4a87-9976-88d75c94286b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:09Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Creating volume 605ab4e6-c5ad-4a87-9976-88d75c94286b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:09 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:34:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:09 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b 1073741824 Sep 28 12:34:09 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:10 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b 1073741824" returned: 0 in 0.504s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:10 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b Sep 28 12:34:10 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:10 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b" returned: 0 in 0.254s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:10 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b9f05b-b67a-4041-9c55-070fd4c6a305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605ab4e6-c5ad-4a87-9976-88d75c94286b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc298e3f-1a9b-4e06-a272-35f22eb1014f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:10 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Volume volume-605ab4e6-c5ad-4a87-9976-88d75c94286b (605ab4e6-c5ad-4a87-9976-88d75c94286b): created successfully Sep 28 12:34:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc298e3f-1a9b-4e06-a272-35f22eb1014f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:10 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (17cbfa9d-fa2d-4782-b76f-c07126faf4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:10 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-b9a91fed-76f3-4e79-a07c-4230548d4435 tempest-ProjectMemberTests-302829666 None] Created volume successfully. Sep 28 12:34:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Creating offline snapshot 775b5af1-c04f-4500-8eaa-db1418ef042e of volume 605ab4e6-c5ad-4a87-9976-88d75c94286b {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:11 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f7df4b-0bf1-4df6-b687-3e45e10c9b8a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:11 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b Sep 28 12:34:11 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:12 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b" returned: 0 in 0.370s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:12 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e 1G Sep 28 12:34:12 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:12 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e 1G" returned: 0 in 0.399s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605ab4e6-c5ad-4a87-9976-88d75c94286b -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:12 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605ab4e6-c5ad-4a87-9976-88d75c94286b -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e Sep 28 12:34:12 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:12 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-605ab4e6-c5ad-4a87-9976-88d75c94286b -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e" returned: 0 in 0.355s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:12 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e is being set with open permissions: ugo+rw Sep 28 12:34:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:12 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e Sep 28 12:34:12 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e" returned: 0 in 0.259s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:13 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.info Sep 28 12:34:13 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.info" returned: 0 in 0.304s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.info is being set with open permissions: ugo+rw Sep 28 12:34:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:13 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.info Sep 28 12:34:13 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:13 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.info" returned: 0 in 0.274s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.069s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-79aeb2e8-e51d-4305-81f5-262bae75ad61 tempest-ProjectMemberTests-302829666 None] Create snapshot completed successfully Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-775b5af1-c04f-4500-8eaa-db1418ef042e-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-775b5af1-c04f-4500-8eaa-db1418ef042e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-605ab4e6-c5ad-4a87-9976-88d75c94286b" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-605ab4e6-c5ad-4a87-9976-88d75c94286b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-775b5af1-c04f-4500-8eaa-db1418ef042e" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-775b5af1-c04f-4500-8eaa-db1418ef042e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Deleting offline snapshot 775b5af1-c04f-4500-8eaa-db1418ef042e of volume 605ab4e6-c5ad-4a87-9976-88d75c94286b {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] snapshot_file for this snap is: volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d2e0c-54c5-4749-bcef-81cd423dbca4]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:15 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e Sep 28 12:34:15 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:15 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e" returned: 0 in 0.374s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-605ab4e6-c5ad-4a87-9976-88d75c94286b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:15 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d2941e-0f70-47e4-b3cc-7e001c157e40]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:15 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b Sep 28 12:34:15 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:15 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b" returned: 0 in 0.397s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:15 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e Sep 28 12:34:15 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:16 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e" returned: 0 in 0.341s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:16 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e Sep 28 12:34:16 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:16 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b.775b5af1-c04f-4500-8eaa-db1418ef042e" returned: 0 in 0.263s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-775b5af1-c04f-4500-8eaa-db1418ef042e" released by "_delete_snapshot" :: held 1.495s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-605ab4e6-c5ad-4a87-9976-88d75c94286b" released by "delete_snapshot" :: held 1.520s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:16 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Created reservations ['8d765142-217c-4d1a-91d0-5161532f5a19', 'd3edb98f-b325-4cef-89f0-21e4d178a53c', '8a8de174-1738-443f-bfd8-f71cdf76bd1d', '6159f5b2-d0a8-4f36-b1d6-9ed0fb6240c4'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:16 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Delete snapshot completed successfully. Sep 28 12:34:16 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-2ec43e6c-5433-469b-9a68-772c28d5fad1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-775b5af1-c04f-4500-8eaa-db1418ef042e-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-605ab4e6-c5ad-4a87-9976-88d75c94286b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Lock "cinder-605ab4e6-c5ad-4a87-9976-88d75c94286b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-605ab4e6-c5ad-4a87-9976-88d75c94286b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-605ab4e6-c5ad-4a87-9976-88d75c94286b" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:17 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d685200-e488-4f15-a2b5-1ee22e10062a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:17 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b Sep 28 12:34:17 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:17 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b" returned: 0 in 0.535s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:17 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b Sep 28 12:34:17 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:18 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-605ab4e6-c5ad-4a87-9976-88d75c94286b" returned: 0 in 0.277s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-605ab4e6-c5ad-4a87-9976-88d75c94286b" released by "delete_volume" :: held 0.901s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Created reservations ['d8e4d75f-699f-45a2-9460-1b5e1ccfa63c', '9943323c-1b73-4f61-aee6-2d5c5f370597', '8aab73a7-f6e0-4a92-b2a8-0f32fbce67cc', '0a33cb0b-d3e7-4cbd-adc4-1dea85f278a9'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:18 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:18 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:18 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.331s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:18 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Deleted volume successfully. Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-08d2fecd-4dd8-433f-9e1d-7ef75653f517 tempest-ProjectMemberTests-302829666 None] Lock "cinder-605ab4e6-c5ad-4a87-9976-88d75c94286b-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (b5d971c6-b410-4d45-be77-8700eaf51044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93539136-2278-4b6a-a84a-770d9134c2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93539136-2278-4b6a-a84a-770d9134c2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1322617864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c59f8d-998f-4443-ad34-b7eeb04bafea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:19Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399580c4-930c-47b9-97b6-e74c003dfa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (399580c4-930c-47b9-97b6-e74c003dfa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32f9d1a-49d1-4cb8-a778-b28e9bbaed9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32f9d1a-49d1-4cb8-a778-b28e9bbaed9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6c59f8d-998f-4443-ad34-b7eeb04bafea', 'volume_name': 'volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d48b655-3178-4527-8d16-185cff3430c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d48b655-3178-4527-8d16-185cff3430c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb6b9a3-5687-49a4-a725-24f21c122551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:18 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Volume d6c59f8d-998f-4443-ad34-b7eeb04bafea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea', 'volume_size': 1} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1322617864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c59f8d-998f-4443-ad34-b7eeb04bafea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:19Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Creating volume d6c59f8d-998f-4443-ad34-b7eeb04bafea {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:18 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:34:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:18 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea 1073741824 Sep 28 12:34:18 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:19 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea 1073741824" returned: 0 in 0.501s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:19 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea Sep 28 12:34:19 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:19 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea" returned: 0 in 0.281s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bb6b9a3-5687-49a4-a725-24f21c122551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec9e187-e320-4f80-9dc0-67be7d1a462c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:19 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Volume volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea (d6c59f8d-998f-4443-ad34-b7eeb04bafea): created successfully Sep 28 12:34:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aec9e187-e320-4f80-9dc0-67be7d1a462c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (b5d971c6-b410-4d45-be77-8700eaf51044) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:19 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-31bec3ae-a410-47d4-94e0-11d74c10355a tempest-ProjectMemberTests-302829666 None] Created volume successfully. Sep 28 12:34:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:21 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Creating offline snapshot 35f092c1-bc9f-40fc-9b62-03f00a8b77a0 of volume d6c59f8d-998f-4443-ad34-b7eeb04bafea {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:21 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fe57d6-fe27-4d6c-a9e1-3276dfcab612]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:21 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea Sep 28 12:34:21 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:21 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea" returned: 0 in 0.367s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:21 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 1G Sep 28 12:34:21 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:21 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 1G" returned: 0 in 0.383s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:21 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 Sep 28 12:34:21 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:22 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0" returned: 0 in 0.283s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:22 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 is being set with open permissions: ugo+rw Sep 28 12:34:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:22 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 Sep 28 12:34:22 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:22 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0" returned: 0 in 0.238s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:22 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.info Sep 28 12:34:22 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:22 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.info" returned: 0 in 0.243s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:22 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.info is being set with open permissions: ugo+rw Sep 28 12:34:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:22 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.info Sep 28 12:34:22 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:22 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.info" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.829s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-00ad2da6-44b6-4762-bb08-520f2f40c82a tempest-ProjectMemberTests-302829666 None] Create snapshot completed successfully Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-35f092c1-bc9f-40fc-9b62-03f00a8b77a0-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Lock "cinder-35f092c1-bc9f-40fc-9b62-03f00a8b77a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-d6c59f8d-998f-4443-ad34-b7eeb04bafea" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-d6c59f8d-998f-4443-ad34-b7eeb04bafea" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-35f092c1-bc9f-40fc-9b62-03f00a8b77a0" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-35f092c1-bc9f-40fc-9b62-03f00a8b77a0" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Deleting offline snapshot 35f092c1-bc9f-40fc-9b62-03f00a8b77a0 of volume d6c59f8d-998f-4443-ad34-b7eeb04bafea {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] snapshot_file for this snap is: volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ab2a8e-4464-44c3-8afe-287f8d2609ef]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:23 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 Sep 28 12:34:23 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:23 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0" returned: 0 in 0.362s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa257f88-774b-4564-ab2c-270502431af9]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:23 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea Sep 28 12:34:23 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:23 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea" returned: 0 in 0.357s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:23 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 Sep 28 12:34:23 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:24 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0" returned: 0 in 0.326s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:24 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0 Sep 28 12:34:24 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:24 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea.35f092c1-bc9f-40fc-9b62-03f00a8b77a0" returned: 0 in 0.265s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-35f092c1-bc9f-40fc-9b62-03f00a8b77a0" released by "_delete_snapshot" :: held 1.406s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-d6c59f8d-998f-4443-ad34-b7eeb04bafea" released by "delete_snapshot" :: held 1.431s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:24 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Created reservations ['4ca5b46a-e67e-4e67-aae8-1627eb07d2ff', '352e6cd0-81c3-432d-a584-944cfbcefe56', '00ee7d72-93cf-454e-b7fc-b78f035b2e78', 'f374dcba-e35d-45b6-a0cc-e3b3e6eefcf7'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:24 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Delete snapshot completed successfully. Sep 28 12:34:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-504d048d-dfda-46e5-8469-60d3488000b8 tempest-ProjectMemberTests-302829666 None] Lock "cinder-35f092c1-bc9f-40fc-9b62-03f00a8b77a0-delete_snapshot" released by "delete_snapshot" :: held 1.565s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-d6c59f8d-998f-4443-ad34-b7eeb04bafea-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Lock "cinder-d6c59f8d-998f-4443-ad34-b7eeb04bafea-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-d6c59f8d-998f-4443-ad34-b7eeb04bafea" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-d6c59f8d-998f-4443-ad34-b7eeb04bafea" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:25 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db33130-77a6-4e6f-a8bc-0b6cd8a9ae1b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:25 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea Sep 28 12:34:25 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:25 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea" returned: 0 in 0.363s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:25 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea Sep 28 12:34:25 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:25 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-d6c59f8d-998f-4443-ad34-b7eeb04bafea" returned: 0 in 0.248s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-d6c59f8d-998f-4443-ad34-b7eeb04bafea" released by "delete_volume" :: held 0.671s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Created reservations ['dcb003f1-dfbd-4386-ad03-436c16cc2fd2', '6d2b17d5-cde1-426f-8b24-c563d94346c2', '4c6d907f-4def-4d10-92f2-5a9ff09e0f54', '0b5dec85-64ff-42cb-89cc-7f2df93a956b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:26 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:26 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:26 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.257s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:26 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Deleted volume successfully. Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f9e71fe6-b8c4-417e-80ca-ea452886e364 tempest-ProjectMemberTests-302829666 None] Lock "cinder-d6c59f8d-998f-4443-ad34-b7eeb04bafea-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (853525fe-f6ce-461d-8abe-995e2c6f61cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64771cd3-7a5f-44d1-bce5-712f9845b6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64771cd3-7a5f-44d1-bce5-712f9845b6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368977690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4057bedf-1400-486c-a620-e3719ed0d3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:27Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74afb302-e436-4361-99c8-89f3079a205d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74afb302-e436-4361-99c8-89f3079a205d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e302e908-5350-48ea-8803-d6a25df894f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e302e908-5350-48ea-8803-d6a25df894f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4057bedf-1400-486c-a620-e3719ed0d3d5', 'volume_name': 'volume-4057bedf-1400-486c-a620-e3719ed0d3d5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abd36ad-5d37-4efe-93a9-332f3f452096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5abd36ad-5d37-4efe-93a9-332f3f452096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53f98f7-7bdc-4d65-bf93-84b46393da42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:26 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Volume 4057bedf-1400-486c-a620-e3719ed0d3d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4057bedf-1400-486c-a620-e3719ed0d3d5', 'volume_size': 1} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1368977690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4057bedf-1400-486c-a620-e3719ed0d3d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:27Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Creating volume 4057bedf-1400-486c-a620-e3719ed0d3d5 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:26 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:34:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:26 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 1073741824 Sep 28 12:34:26 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:27 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 1073741824" returned: 0 in 0.411s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:27 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 Sep 28 12:34:27 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:27 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5" returned: 0 in 0.240s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53f98f7-7bdc-4d65-bf93-84b46393da42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4057bedf-1400-486c-a620-e3719ed0d3d5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298722ab-23bd-47e9-bda3-9fcc78155a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:27 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Volume volume-4057bedf-1400-486c-a620-e3719ed0d3d5 (4057bedf-1400-486c-a620-e3719ed0d3d5): created successfully Sep 28 12:34:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (298722ab-23bd-47e9-bda3-9fcc78155a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (853525fe-f6ce-461d-8abe-995e2c6f61cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-794c6849-113d-4093-b1fb-9ba9e715ec05 tempest-ProjectMemberTests-302829666 None] Created volume successfully. Sep 28 12:34:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:28 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Creating offline snapshot 37af4dc4-1ea9-44bb-9d69-6299381df26a of volume 4057bedf-1400-486c-a620-e3719ed0d3d5 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:28 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d86515-2d9b-497b-b3f2-8c4f45edee16]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:28 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 Sep 28 12:34:28 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:28 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5" returned: 0 in 0.363s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:28 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a 1G Sep 28 12:34:28 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:28 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a 1G" returned: 0 in 0.389s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4057bedf-1400-486c-a620-e3719ed0d3d5 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:28 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4057bedf-1400-486c-a620-e3719ed0d3d5 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a Sep 28 12:34:28 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:29 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4057bedf-1400-486c-a620-e3719ed0d3d5 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a" returned: 0 in 0.293s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:29 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a is being set with open permissions: ugo+rw Sep 28 12:34:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:29 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a Sep 28 12:34:29 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:29 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a" returned: 0 in 0.240s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:29 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.info Sep 28 12:34:29 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:29 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.info" returned: 0 in 0.259s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:29 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.info is being set with open permissions: ugo+rw Sep 28 12:34:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:29 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.info Sep 28 12:34:29 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:29 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.info" returned: 0 in 0.237s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d1378233-f332-40a7-8dfd-33f61a22b261 tempest-ProjectMemberTests-302829666 None] Create snapshot completed successfully Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-37af4dc4-1ea9-44bb-9d69-6299381df26a-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Lock "cinder-37af4dc4-1ea9-44bb-9d69-6299381df26a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-4057bedf-1400-486c-a620-e3719ed0d3d5" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-4057bedf-1400-486c-a620-e3719ed0d3d5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-37af4dc4-1ea9-44bb-9d69-6299381df26a" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-37af4dc4-1ea9-44bb-9d69-6299381df26a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Deleting offline snapshot 37af4dc4-1ea9-44bb-9d69-6299381df26a of volume 4057bedf-1400-486c-a620-e3719ed0d3d5 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] snapshot_file for this snap is: volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bad61b-fbac-43d5-bd1c-2c5b4cad01a6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:30 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a Sep 28 12:34:30 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:30 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a" returned: 0 in 0.369s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4057bedf-1400-486c-a620-e3719ed0d3d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd918337-3df3-4164-9f6d-3a84033881b7]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:30 devstack sudo[107142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 Sep 28 12:34:30 devstack sudo[107142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:30 devstack sudo[107142]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5" returned: 0 in 0.348s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:30 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a Sep 28 12:34:30 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:31 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:31 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a Sep 28 12:34:31 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:31 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5.37af4dc4-1ea9-44bb-9d69-6299381df26a" returned: 0 in 0.242s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-37af4dc4-1ea9-44bb-9d69-6299381df26a" released by "_delete_snapshot" :: held 1.389s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-4057bedf-1400-486c-a620-e3719ed0d3d5" released by "delete_snapshot" :: held 1.410s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:31 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Created reservations ['0f8d5d7b-6a4f-4186-b07d-bca97fecb811', '01e01982-b8d1-4299-9d32-c3365454e699', '6b2cb645-521d-4e8f-bd60-3b0436190d04', '1a5530df-7e7e-4cfd-9c1f-51779d73ea27'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:31 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Delete snapshot completed successfully. Sep 28 12:34:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-af2dfe1d-7afb-4646-8478-4861a4da2e4b tempest-ProjectMemberTests-302829666 None] Lock "cinder-37af4dc4-1ea9-44bb-9d69-6299381df26a-delete_snapshot" released by "delete_snapshot" :: held 1.539s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-4057bedf-1400-486c-a620-e3719ed0d3d5-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Lock "cinder-4057bedf-1400-486c-a620-e3719ed0d3d5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:INSERT=56,cinder:UPDATE=200,cinder:SELECT=151,cinder:DELETE=12 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=143,cinder:INSERT=44,cinder:UPDATE=184,cinder:DELETE=21 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-4057bedf-1400-486c-a620-e3719ed0d3d5" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-4057bedf-1400-486c-a620-e3719ed0d3d5" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a6f57b-4030-4a0b-b646-3d322507d5cb]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:32 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 Sep 28 12:34:32 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:32 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5" returned: 0 in 0.362s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:32 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5 Sep 28 12:34:32 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:32 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4057bedf-1400-486c-a620-e3719ed0d3d5" returned: 0 in 0.244s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-4057bedf-1400-486c-a620-e3719ed0d3d5" released by "delete_volume" :: held 0.667s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Created reservations ['38503f6e-9050-4299-8959-c14a89ef1c14', '92731ece-01e1-46d5-bb2c-c2fbf23efe42', 'b2676bc0-0f75-4bb1-99ae-37766edfe456', '6f5cbafa-22d8-4392-ae62-4a34d625f1a1'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:33 devstack sudo[107164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:33 devstack sudo[107164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:33 devstack sudo[107164]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.244s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Deleted volume successfully. Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3383e9c3-e5b5-4856-a5a3-dbdb4c7b7514 tempest-ProjectMemberTests-302829666 None] Lock "cinder-4057bedf-1400-486c-a620-e3719ed0d3d5-delete_volume" released by "delete_volume" :: held 1.109s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (e2714d49-c8a2-4c9b-9a97-24bde742a9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a5d5fa-83f4-4ea9-bf66-b676ed8158ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85a5d5fa-83f4-4ea9-bf66-b676ed8158ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349069651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8b74ec-0c12-40f6-8306-6f95e3ab3d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:34Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dcde10-1abb-49e7-8242-f036bb4ad720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7dcde10-1abb-49e7-8242-f036bb4ad720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba9f2f2-6d21-49da-8075-b935e51c11fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba9f2f2-6d21-49da-8075-b935e51c11fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b8b74ec-0c12-40f6-8306-6f95e3ab3d40', 'volume_name': 'volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d26ede3-f0ce-4706-98ad-4144afef3d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d26ede3-f0ce-4706-98ad-4144afef3d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13060c2-0781-4e5e-a63d-4388498d4fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:33 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Volume 4b8b74ec-0c12-40f6-8306-6f95e3ab3d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40', 'volume_size': 1} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349069651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b8b74ec-0c12-40f6-8306-6f95e3ab3d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:34Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Creating volume 4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:33 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:34:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:33 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 1073741824 Sep 28 12:34:33 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:34 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 1073741824" returned: 0 in 0.412s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:34 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 Sep 28 12:34:34 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:34 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" returned: 0 in 0.244s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13060c2-0781-4e5e-a63d-4388498d4fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afab261-964f-4161-909e-51046c9a9042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:34 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Volume volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 (4b8b74ec-0c12-40f6-8306-6f95e3ab3d40): created successfully Sep 28 12:34:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9afab261-964f-4161-909e-51046c9a9042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (e2714d49-c8a2-4c9b-9a97-24bde742a9dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9f415d28-8915-43e2-8d7a-350a019fc528 tempest-ProjectMemberTests-302829666 None] Created volume successfully. Sep 28 12:34:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:35 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Creating offline snapshot 41f31677-b145-4650-9a57-8d3e3ee5d269 of volume 4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:35 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa45903-1be5-41f8-9fa7-bdbfdb89c9b6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:35 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 Sep 28 12:34:35 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:35 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:35 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 1G Sep 28 12:34:35 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:35 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 1G" returned: 0 in 0.386s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:35 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 Sep 28 12:34:35 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269" returned: 0 in 0.281s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:36 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 is being set with open permissions: ugo+rw Sep 28 12:34:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:36 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 Sep 28 12:34:36 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269" returned: 0 in 0.247s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:36 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.info Sep 28 12:34:36 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.info" returned: 0 in 0.252s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:36 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.info is being set with open permissions: ugo+rw Sep 28 12:34:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:36 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.info Sep 28 12:34:36 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:36 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.info" returned: 0 in 0.234s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:36 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-805378a5-93e7-456a-af7f-b59199772cc3 tempest-ProjectMemberTests-302829666 None] Create snapshot completed successfully Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-41f31677-b145-4650-9a57-8d3e3ee5d269-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Lock "cinder-41f31677-b145-4650-9a57-8d3e3ee5d269-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-41f31677-b145-4650-9a57-8d3e3ee5d269" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-41f31677-b145-4650-9a57-8d3e3ee5d269" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Deleting offline snapshot 41f31677-b145-4650-9a57-8d3e3ee5d269 of volume 4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] snapshot_file for this snap is: volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f821f644-dae0-48d7-beb8-10faba335f7a]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:37 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 Sep 28 12:34:37 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:37 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bcbd757-76cf-4275-a35b-90822e855574]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:37 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 Sep 28 12:34:37 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:37 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" returned: 0 in 0.341s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:37 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 Sep 28 12:34:37 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:38 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:38 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:38 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269" returned: 0 in 0.344s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:38 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269 Sep 28 12:34:38 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:38 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.242s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:34:38 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40.41f31677-b145-4650-9a57-8d3e3ee5d269" returned: 0 in 0.245s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-41f31677-b145-4650-9a57-8d3e3ee5d269" released by "_delete_snapshot" :: held 1.381s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" released by "delete_snapshot" :: held 1.402s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Created reservations ['f91dda34-b947-42d4-878b-2208ed28180c', '233cb33e-6c87-4d7a-8185-8838fd75cdf1', 'e0efadf3-7384-4186-b9a3-cdb570f876d9', '26c0be17-04d6-4ffb-88b9-fe2636253164'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Delete snapshot completed successfully. Sep 28 12:34:38 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-d2b398cb-8392-459a-a11e-b205cb816275 tempest-ProjectMemberTests-302829666 None] Lock "cinder-41f31677-b145-4650-9a57-8d3e3ee5d269-delete_snapshot" released by "delete_snapshot" :: held 1.530s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:39 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:39 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Lock "cinder-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:39 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:39 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:39 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[430daf32-7383-40c9-af0b-43ef25fb90fd]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:39 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 Sep 28 12:34:39 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:39 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" returned: 0 in 0.363s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:39 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40 Sep 28 12:34:39 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:40 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" returned: 0 in 0.253s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40" released by "delete_volume" :: held 0.677s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Created reservations ['dc98b3f1-5aca-4556-89dd-8eb0347f7a41', 'cdb03fd6-6c94-430c-b9f6-1205af341f79', '7bdb01ef-4ced-4035-a640-654e922d07ce', '718187a0-20ce-4524-b922-7d27d8e3ec80'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:40 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:40 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:40 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.237s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:40 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Deleted volume successfully. Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-a406a916-e759-4473-81f9-0266601be149 tempest-ProjectMemberTests-302829666 None] Lock "cinder-4b8b74ec-0c12-40f6-8306-6f95e3ab3d40-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (b2c4b219-ba8e-4133-a2f5-f1c60de496ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0669313-b405-4581-94a6-9044031253d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0669313-b405-4581-94a6-9044031253d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991804028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79558197-8bf3-4349-84c0-7b67e75926c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:41Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd13dfb-d04a-464b-a495-4c5327669bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd13dfb-d04a-464b-a495-4c5327669bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9e3ff0-79c6-4055-8025-1f01844d0751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca9e3ff0-79c6-4055-8025-1f01844d0751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79558197-8bf3-4349-84c0-7b67e75926c5', 'volume_name': 'volume-79558197-8bf3-4349-84c0-7b67e75926c5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb21f38-ba02-4e63-b28f-4674e6d8b2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fb21f38-ba02-4e63-b28f-4674e6d8b2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293d22d6-c224-4583-b704-5cac754e4781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:40 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Volume 79558197-8bf3-4349-84c0-7b67e75926c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79558197-8bf3-4349-84c0-7b67e75926c5', 'volume_size': 1} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-991804028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79558197-8bf3-4349-84c0-7b67e75926c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:41Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Creating volume 79558197-8bf3-4349-84c0-7b67e75926c5 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:40 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:34:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:41 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 1073741824 Sep 28 12:34:41 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:41 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 1073741824" returned: 0 in 0.416s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:41 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 Sep 28 12:34:41 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:41 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5" returned: 0 in 0.238s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:41 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:41 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (293d22d6-c224-4583-b704-5cac754e4781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79558197-8bf3-4349-84c0-7b67e75926c5', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2a90e7-b0b4-4c5e-a1c5-9051bcfb96d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:41 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Volume volume-79558197-8bf3-4349-84c0-7b67e75926c5 (79558197-8bf3-4349-84c0-7b67e75926c5): created successfully Sep 28 12:34:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd2a90e7-b0b4-4c5e-a1c5-9051bcfb96d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:41 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (b2c4b219-ba8e-4133-a2f5-f1c60de496ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:41 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-84a210d0-d2ed-448b-9dc2-ac2621096dbc tempest-ProjectMemberTests-302829666 None] Created volume successfully. Sep 28 12:34:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:42 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Creating offline snapshot 6441975f-3137-451e-9094-cca4eaba3e52 of volume 79558197-8bf3-4349-84c0-7b67e75926c5 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:42 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[835703fc-a65e-4ed4-abd9-f4f7bbdbde8d]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:42 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 Sep 28 12:34:42 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:42 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5" returned: 0 in 0.359s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:42 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 1G Sep 28 12:34:42 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:42 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 1G" returned: 0 in 0.380s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:42 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79558197-8bf3-4349-84c0-7b67e75926c5 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:42 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79558197-8bf3-4349-84c0-7b67e75926c5 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 Sep 28 12:34:42 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:43 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79558197-8bf3-4349-84c0-7b67e75926c5 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52" returned: 0 in 0.280s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:43 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 is being set with open permissions: ugo+rw Sep 28 12:34:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:43 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 Sep 28 12:34:43 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:43 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52" returned: 0 in 0.242s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:43 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.info Sep 28 12:34:43 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:43 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.info" returned: 0 in 0.245s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:43 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.info is being set with open permissions: ugo+rw Sep 28 12:34:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:43 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.info Sep 28 12:34:43 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:43 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.info" returned: 0 in 0.242s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:43 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.825s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:43 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5a214881-8e08-40d2-88d2-75fd90540e58 tempest-ProjectMemberTests-302829666 None] Create snapshot completed successfully Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-6441975f-3137-451e-9094-cca4eaba3e52-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Lock "cinder-6441975f-3137-451e-9094-cca4eaba3e52-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-79558197-8bf3-4349-84c0-7b67e75926c5" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-79558197-8bf3-4349-84c0-7b67e75926c5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-6441975f-3137-451e-9094-cca4eaba3e52" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-6441975f-3137-451e-9094-cca4eaba3e52" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Deleting offline snapshot 6441975f-3137-451e-9094-cca4eaba3e52 of volume 79558197-8bf3-4349-84c0-7b67e75926c5 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] snapshot_file for this snap is: volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efe4a5f-2d1b-44dd-9fc7-184720187392]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:44 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 Sep 28 12:34:44 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:44 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52" returned: 0 in 0.350s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79558197-8bf3-4349-84c0-7b67e75926c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d087b57-4cae-46fc-96cf-885f5dfd69fa]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:44 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 Sep 28 12:34:44 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:44 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5" returned: 0 in 0.341s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:44 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:45 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 Sep 28 12:34:45 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:45 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52" returned: 0 in 0.344s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:45 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52 Sep 28 12:34:45 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:45 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:45 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5.6441975f-3137-451e-9094-cca4eaba3e52" returned: 0 in 0.260s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-6441975f-3137-451e-9094-cca4eaba3e52" released by "_delete_snapshot" :: held 1.391s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-79558197-8bf3-4349-84c0-7b67e75926c5" released by "delete_snapshot" :: held 1.414s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:45 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Created reservations ['e82f11a5-3c04-419a-9b72-8c48125bc22f', 'ea951a0e-f751-4e5e-9883-1b7c8b1a62db', '08dca3b5-74f9-4514-ad56-0a818bc6ed98', 'f8bb82a8-da12-4274-a13c-0eefc2cc6801'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:45 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Delete snapshot completed successfully. Sep 28 12:34:45 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-197805a8-971a-4839-bdbc-d4312a988ebf tempest-ProjectMemberTests-302829666 None] Lock "cinder-6441975f-3137-451e-9094-cca4eaba3e52-delete_snapshot" released by "delete_snapshot" :: held 1.542s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-79558197-8bf3-4349-84c0-7b67e75926c5-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Lock "cinder-79558197-8bf3-4349-84c0-7b67e75926c5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-79558197-8bf3-4349-84c0-7b67e75926c5" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:46 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-79558197-8bf3-4349-84c0-7b67e75926c5" acquired by "delete_volume" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:46 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbca3f0d-6a9b-42ea-b1d8-64999ffb2e41]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:46 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 Sep 28 12:34:46 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:46 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5" returned: 0 in 0.359s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:46 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:46 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5 Sep 28 12:34:46 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:47 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-79558197-8bf3-4349-84c0-7b67e75926c5" returned: 0 in 0.249s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-79558197-8bf3-4349-84c0-7b67e75926c5" released by "delete_volume" :: held 0.669s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Created reservations ['860d5cf8-888f-4fb0-8619-3b1270e48929', '497d1e11-9f77-4a27-a206-c71fc5b62207', 'ba5962ed-7501-437c-8faf-82339b03f8ce', 'cb73d7c6-a8d2-42b4-8237-4645706bc798'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:47 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:47 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:47 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.233s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:47 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Deleted volume successfully. Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-6ac41059-d7ed-4d2b-82d0-c262a80358ce tempest-ProjectMemberTests-302829666 None] Lock "cinder-79558197-8bf3-4349-84c0-7b67e75926c5-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (07991219-942c-4140-9377-a518213bc379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce0fa79-21f1-4fa4-ada0-8ecd506e7c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ce0fa79-21f1-4fa4-ada0-8ecd506e7c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393709502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9c62e9-16c4-4a58-bd90-18d781caf991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:48Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a767657-ff3f-411c-9c02-89208e134833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a767657-ff3f-411c-9c02-89208e134833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ad98c2-7a02-444a-b30c-3b9067fbfc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7ad98c2-7a02-444a-b30c-3b9067fbfc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9c62e9-16c4-4a58-bd90-18d781caf991', 'volume_name': 'volume-aa9c62e9-16c4-4a58-bd90-18d781caf991', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8444f917-be8e-4a4c-af95-1101db1a3391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8444f917-be8e-4a4c-af95-1101db1a3391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9298f73-975e-4c2d-b473-d8448acab311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:47 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Volume aa9c62e9-16c4-4a58-bd90-18d781caf991: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9c62e9-16c4-4a58-bd90-18d781caf991', 'volume_size': 1} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-393709502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa9c62e9-16c4-4a58-bd90-18d781caf991,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:48Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Creating volume aa9c62e9-16c4-4a58-bd90-18d781caf991 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:47 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:34:47 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:48 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 1073741824 Sep 28 12:34:48 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:48 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 1073741824" returned: 0 in 0.400s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:48 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 Sep 28 12:34:48 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:48 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991" returned: 0 in 0.254s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:48 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:48 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9298f73-975e-4c2d-b473-d8448acab311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9c62e9-16c4-4a58-bd90-18d781caf991', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17b47a5-19be-4fbb-af2b-cab31c8b2839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:48 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Volume volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 (aa9c62e9-16c4-4a58-bd90-18d781caf991): created successfully Sep 28 12:34:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17b47a5-19be-4fbb-af2b-cab31c8b2839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:48 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (07991219-942c-4140-9377-a518213bc379) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:48 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4c828009-d9de-4515-b967-ccb559550f02 tempest-ProjectMemberTests-302829666 None] Created volume successfully. Sep 28 12:34:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:49 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Creating offline snapshot 73d591da-bd37-481c-a960-eb53e7302a95 of volume aa9c62e9-16c4-4a58-bd90-18d781caf991 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:49 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1102d34-c0cc-407e-a7e3-30275a3a2afd]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:49 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 Sep 28 12:34:49 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:49 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991" returned: 0 in 0.358s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:49 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 1G Sep 28 12:34:49 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:49 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 1G" returned: 0 in 0.393s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:49 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:49 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 Sep 28 12:34:49 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:50 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95" returned: 0 in 0.285s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:50 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 is being set with open permissions: ugo+rw Sep 28 12:34:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:50 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 Sep 28 12:34:50 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:50 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95" returned: 0 in 0.242s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:50 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.info Sep 28 12:34:50 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:50 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.info" returned: 0 in 0.252s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:50 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.info is being set with open permissions: ugo+rw Sep 28 12:34:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:50 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.info Sep 28 12:34:50 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:50 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.info" returned: 0 in 0.241s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:50 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:50 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f2bd6c01-0695-4d22-9781-c6e6a8da24be tempest-ProjectMemberTests-302829666 None] Create snapshot completed successfully Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-73d591da-bd37-481c-a960-eb53e7302a95-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Lock "cinder-73d591da-bd37-481c-a960-eb53e7302a95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-aa9c62e9-16c4-4a58-bd90-18d781caf991" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-aa9c62e9-16c4-4a58-bd90-18d781caf991" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-73d591da-bd37-481c-a960-eb53e7302a95" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-73d591da-bd37-481c-a960-eb53e7302a95" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Deleting offline snapshot 73d591da-bd37-481c-a960-eb53e7302a95 of volume aa9c62e9-16c4-4a58-bd90-18d781caf991 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] snapshot_file for this snap is: volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7bb582-77d5-4fa2-9e47-d335cb258b90]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:51 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 Sep 28 12:34:51 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:51 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95" returned: 0 in 0.375s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa9c62e9-16c4-4a58-bd90-18d781caf991(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1efd1170-a0d9-47f9-920b-36b5ba20de95]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:51 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:51 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 Sep 28 12:34:51 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:52 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991" returned: 0 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:52 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 Sep 28 12:34:52 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:52 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:52 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95 Sep 28 12:34:52 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:52 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:52 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991.73d591da-bd37-481c-a960-eb53e7302a95" returned: 0 in 0.275s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-73d591da-bd37-481c-a960-eb53e7302a95" released by "_delete_snapshot" :: held 1.445s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-aa9c62e9-16c4-4a58-bd90-18d781caf991" released by "delete_snapshot" :: held 1.465s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:52 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Created reservations ['4c2935bc-3544-4162-9899-ebc16e072d2c', '2454e7fd-9e8d-499f-aa9c-9ae54b4c61ba', '35a1d47e-2eba-4ced-9dee-96cd7288244a', '6225480f-cef7-4aae-acd4-5ce808bb0786'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:52 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Delete snapshot completed successfully. Sep 28 12:34:52 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7796a218-d509-4a93-b341-548d4d9cc4c4 tempest-ProjectMemberTests-302829666 None] Lock "cinder-73d591da-bd37-481c-a960-eb53e7302a95-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-aa9c62e9-16c4-4a58-bd90-18d781caf991-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Lock "cinder-aa9c62e9-16c4-4a58-bd90-18d781caf991-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-aa9c62e9-16c4-4a58-bd90-18d781caf991" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:53 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-aa9c62e9-16c4-4a58-bd90-18d781caf991" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:53 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ca2e86-740d-4069-b15c-6db94b77a850]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:53 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 Sep 28 12:34:53 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:53 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991" returned: 0 in 0.386s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:53 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:53 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991 Sep 28 12:34:53 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:54 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-aa9c62e9-16c4-4a58-bd90-18d781caf991" returned: 0 in 0.260s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-aa9c62e9-16c4-4a58-bd90-18d781caf991" released by "delete_volume" :: held 0.711s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Created reservations ['053e2e9f-4365-4ed4-bcf2-dd471ce75826', 'accdc196-b28b-465d-9f06-536ba8f807f6', 'd7f3f6d2-a3e1-47b8-bdb2-6e83325ce58b', '9f001bf4-1606-4d5b-b9aa-20164c715c28'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:54 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:34:54 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:54 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.246s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:34:54 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Deleted volume successfully. Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-f3414aad-d099-46c2-aeba-62ec984525c7 tempest-ProjectMemberTests-302829666 None] Lock "cinder-aa9c62e9-16c4-4a58-bd90-18d781caf991-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (a3dd479a-70c6-4a87-8b31-58a78a9155a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dc89a4-8f15-4183-b9ab-b8d3b8f25673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43dc89a4-8f15-4183-b9ab-b8d3b8f25673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-721237661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc5d6f2-1afe-4b01-9afa-f48340632ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:55Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0059a3-d9d2-4657-8cfe-4307629af138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a0059a3-d9d2-4657-8cfe-4307629af138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c609ef6e-e4d7-4eed-aac0-f7884f855d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:54 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c609ef6e-e4d7-4eed-aac0-f7884f855d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc5d6f2-1afe-4b01-9afa-f48340632ce3', 'volume_name': 'volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3477a8-f573-4b22-8f78-b99790865a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3477a8-f573-4b22-8f78-b99790865a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0294aad-49dc-44e2-8361-43f6141e1503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:55 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Volume 9bc5d6f2-1afe-4b01-9afa-f48340632ce3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3', 'volume_size': 1} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:34:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-721237661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc5d6f2-1afe-4b01-9afa-f48340632ce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cf6790ee4b4c29b2cbebe45662ef7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:34:55Z,use_quota=True,user_id='186e326044e243c4acf77285e8dbe0a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Creating volume 9bc5d6f2-1afe-4b01-9afa-f48340632ce3 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:34:55 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:55 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 1073741824 Sep 28 12:34:55 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:55 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 1073741824" returned: 0 in 0.436s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:55 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 Sep 28 12:34:55 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:55 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" returned: 0 in 0.262s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0294aad-49dc-44e2-8361-43f6141e1503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001d64dc-b1ef-4099-a157-d17cf2d584e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:34:55 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Volume volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 (9bc5d6f2-1afe-4b01-9afa-f48340632ce3): created successfully Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (001d64dc-b1ef-4099-a157-d17cf2d584e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:34:55 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Flow 'volume_create_manager' (a3dd479a-70c6-4a87-8b31-58a78a9155a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:34:55 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-beebe026-90ce-4ed6-860b-1cf07c213e13 tempest-ProjectMemberTests-302829666 None] Created volume successfully. Sep 28 12:34:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:34:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:34:56 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Creating offline snapshot 38334cce-f227-4c19-b610-6eadcedf2f7f of volume 9bc5d6f2-1afe-4b01-9afa-f48340632ce3 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:34:56 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e804d8-4fe3-49a8-8871-f7028babb904]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:56 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 Sep 28 12:34:56 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:56 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" returned: 0 in 0.360s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:56 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f 1G Sep 28 12:34:56 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:56 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f 1G" returned: 0 in 0.390s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:56 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:56 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f Sep 28 12:34:56 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:57 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f" returned: 0 in 0.283s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:57 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f is being set with open permissions: ugo+rw Sep 28 12:34:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:57 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f Sep 28 12:34:57 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:57 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f" returned: 0 in 0.244s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:57 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.info Sep 28 12:34:57 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:57 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.info" returned: 0 in 0.257s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:57 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.info is being set with open permissions: ugo+rw Sep 28 12:34:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:57 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.info Sep 28 12:34:57 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:57 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.info" returned: 0 in 0.240s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:57 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:34:57 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-09fc4b29-51b5-4e04-8611-b793cc95d9d4 tempest-ProjectMemberTests-302829666 None] Create snapshot completed successfully Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-38334cce-f227-4c19-b610-6eadcedf2f7f-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Lock "cinder-38334cce-f227-4c19-b610-6eadcedf2f7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-38334cce-f227-4c19-b610-6eadcedf2f7f" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-38334cce-f227-4c19-b610-6eadcedf2f7f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Deleting offline snapshot 38334cce-f227-4c19-b610-6eadcedf2f7f of volume 9bc5d6f2-1afe-4b01-9afa-f48340632ce3 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] snapshot_file for this snap is: volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[66715027-5c20-4e1b-a453-35f1a0aa0375]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:58 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f Sep 28 12:34:58 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:58 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a97f97-c519-41dd-9955-7496a9fd6ea9]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:34:58 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:58 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 Sep 28 12:34:58 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:59 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" returned: 0 in 0.379s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:59 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f Sep 28 12:34:59 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:59 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f" returned: 0 in 0.359s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:34:59 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f Sep 28 12:34:59 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:34:59 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 28 12:34:59 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3.38334cce-f227-4c19-b610-6eadcedf2f7f" returned: 0 in 0.247s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:34:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-38334cce-f227-4c19-b610-6eadcedf2f7f" released by "_delete_snapshot" :: held 1.440s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" released by "delete_snapshot" :: held 1.461s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:34:59 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Created reservations ['98a0df32-5fce-4038-bc74-541902a28356', '9d0ba434-c322-412f-b960-99210b94edd0', 'a58ece04-664a-4e67-a158-8f79bfd6c4f6', 'df397701-a37d-40a3-8ffa-f748ee81d534'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:34:59 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Delete snapshot completed successfully. Sep 28 12:34:59 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-7c6cad2d-635b-4aa5-bf07-7c7699b7f3aa tempest-ProjectMemberTests-302829666 None] Lock "cinder-38334cce-f227-4c19-b610-6eadcedf2f7f-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-9bc5d6f2-1afe-4b01-9afa-f48340632ce3-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-9bc5d6f2-1afe-4b01-9afa-f48340632ce3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Acquiring lock "cinder-quobyte-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:00 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:00 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[401ed309-928c-48a9-a709-1ef99605e53e]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:00 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 Sep 28 12:35:00 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:00 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" returned: 0 in 0.369s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:00 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:00 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3 Sep 28 12:35:00 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:01 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" returned: 0 in 0.244s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-quobyte-9bc5d6f2-1afe-4b01-9afa-f48340632ce3" released by "delete_volume" :: held 0.673s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Created reservations ['9b695378-c5f4-491d-a209-0bdbd04698b3', '87699017-1aff-400a-b528-758d0a643ab4', 'b4e3dd45-ff17-4dda-96e4-df913e53141c', 'b4c3fcb9-a6ef-4c5d-b326-ceee9a7472c7'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:01 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:35:01 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:01 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.279s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:01 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Deleted volume successfully. Sep 28 12:35:01 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-67906494-1d8a-4f45-9482-bf212de861a1 tempest-ProjectMemberTests-302829666 None] Lock "cinder-9bc5d6f2-1afe-4b01-9afa-f48340632ce3-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (6c2daf78-3adf-4c56-a8b2-f6f5870ec5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae799fb4-2f4b-4f80-a6ea-828a09198242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae799fb4-2f4b-4f80-a6ea-828a09198242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182581110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:05Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403d71b6-a770-4176-b701-4edde7de89fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (403d71b6-a770-4176-b701-4edde7de89fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e028ee86-9b96-487b-b32d-491921826a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e028ee86-9b96-487b-b32d-491921826a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb', 'volume_name': 'volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79edb499-8f84-4b58-af48-a16f412855b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79edb499-8f84-4b58-af48-a16f412855b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c448f59-35b4-488b-abba-b6d2d27c7696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Volume 7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb', 'volume_size': 1} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182581110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:05Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Creating volume 7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:05 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:05 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb 1073741824 Sep 28 12:35:05 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:05 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb 1073741824" returned: 0 in 0.415s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:05 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb Sep 28 12:35:05 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:05 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" returned: 0 in 0.243s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c448f59-35b4-488b-abba-b6d2d27c7696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee48cd9-33bd-4e99-91fb-751d6b170501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:05 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Volume volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb (7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb): created successfully Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee48cd9-33bd-4e99-91fb-751d6b170501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:05 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (6c2daf78-3adf-4c56-a8b2-f6f5870ec5f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:05 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-9432b2b0-5e14-489f-9018-a5c0a79785e1 tempest-ProjectReaderTests-1421538232 None] Created volume successfully. Sep 28 12:35:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:06 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Creating offline snapshot d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a of volume 7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:06 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f589f7bb-63f9-4158-a7c1-13467030ec94]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:06 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb Sep 28 12:35:06 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:06 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" returned: 0 in 0.355s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:06 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:06 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a 1G Sep 28 12:35:06 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:07 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a 1G" returned: 0 in 0.395s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:07 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a Sep 28 12:35:07 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:07 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a" returned: 0 in 0.286s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:07 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a is being set with open permissions: ugo+rw Sep 28 12:35:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:07 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a Sep 28 12:35:07 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:07 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a" returned: 0 in 0.247s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:07 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.info Sep 28 12:35:07 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:07 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.info" returned: 0 in 0.245s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:07 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.info is being set with open permissions: ugo+rw Sep 28 12:35:07 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:07 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.info Sep 28 12:35:07 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:08 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.info" returned: 0 in 0.247s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:08 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-53390760-05df-4111-8d8d-829f0206bd20 tempest-ProjectReaderTests-1421538232 None] Create snapshot completed successfully Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Deleting offline snapshot d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a of volume 7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] snapshot_file for this snap is: volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfc1b00-f4b3-4191-81c2-a876800e3274]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:08 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a Sep 28 12:35:08 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:08 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a" returned: 0 in 0.357s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[28456c15-e413-49b6-8e43-db1fb8531508]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:08 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:09 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb Sep 28 12:35:09 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:09 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" returned: 0 in 0.355s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:09 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a Sep 28 12:35:09 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:09 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a" returned: 0 in 0.328s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:09 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a Sep 28 12:35:09 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:09 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:09 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb.d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a" returned: 0 in 0.236s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a" released by "_delete_snapshot" :: held 1.371s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:09 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" released by "delete_snapshot" :: held 1.390s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:10 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Created reservations ['3d5e6169-c1a5-4bc2-8968-30af01a2ba5e', '9e28b95a-b40e-4400-bc67-7a2ae79846cc', 'e3294f8e-4bba-47c9-bc30-5a6b3fc822b3', '038b7cd7-afa3-4f4d-ada7-1cd88c861307'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:10 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Delete snapshot completed successfully. Sep 28 12:35:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-ff97fdc2-0fc0-4538-b144-8392239cb9a1 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-d0179b3b-00bb-4f9a-b9f4-97b55cca9b1a-delete_snapshot" released by "delete_snapshot" :: held 1.519s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:10 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" acquired by "delete_volume" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:10 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc45dad5-e1a7-4795-b343-f67ec7ecd2e3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:10 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:10 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb Sep 28 12:35:10 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:11 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:11 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb Sep 28 12:35:11 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:11 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" returned: 0 in 0.253s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb" released by "delete_volume" :: held 0.672s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Created reservations ['2fa915df-07f6-43ab-8ddb-cf34e149164c', 'c829e01a-fe1f-48d6-bc6a-f316136c4d02', '1f6cb832-91d7-45f7-ab5f-426644ab9148', '695c20cf-a573-497b-9c67-2274f0c23bf7'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:11 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:35:11 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:11 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.248s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:11 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Deleted volume successfully. Sep 28 12:35:11 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cb46cef6-b3eb-40f2-99be-46a2a348f826 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-7bb06fe1-ab4f-4e0e-af76-0d3234eebbfb-delete_volume" released by "delete_volume" :: held 1.112s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (67809ea2-2f8c-4339-86f6-c5173ae3224b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e4d910-9efe-425d-b38b-081d2d2aebda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e4d910-9efe-425d-b38b-081d2d2aebda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777955451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:12Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c506d990-c1b8-48c8-89d3-e7825582af82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c506d990-c1b8-48c8-89d3-e7825582af82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1f0c0b-a02c-4232-86dc-5ffad52828c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1f0c0b-a02c-4232-86dc-5ffad52828c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b', 'volume_name': 'volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a17763-e7cd-4063-a947-acf5e0c866fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97a17763-e7cd-4063-a947-acf5e0c866fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a299a55-55a0-453d-890c-32c625813ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:12 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Volume 3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b', 'volume_size': 1} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777955451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:12Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Creating volume 3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:12 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:12 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b 1073741824 Sep 28 12:35:12 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:12 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b 1073741824" returned: 0 in 0.429s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:12 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:12 devstack sudo[107538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b Sep 28 12:35:12 devstack sudo[107538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:13 devstack sudo[107538]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" returned: 0 in 0.255s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a299a55-55a0-453d-890c-32c625813ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f09913b-52a8-44bb-b23b-2ca17cbaeb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:13 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Volume volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b (3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b): created successfully Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f09913b-52a8-44bb-b23b-2ca17cbaeb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (67809ea2-2f8c-4339-86f6-c5173ae3224b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:13 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-00ceea41-ec39-489b-88bb-3508a5da8423 tempest-ProjectReaderTests-1421538232 None] Created volume successfully. Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Creating offline snapshot 74bc7438-0988-49d7-b7dd-0d013022c018 of volume 3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[2741c279-9501-4fc8-8535-b63e6c4774e6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:13 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b Sep 28 12:35:13 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:13 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" returned: 0 in 0.367s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:13 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:13 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 1G Sep 28 12:35:13 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:14 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 1G" returned: 0 in 0.392s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:14 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 Sep 28 12:35:14 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:14 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018" returned: 0 in 0.295s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:14 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 is being set with open permissions: ugo+rw Sep 28 12:35:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:14 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 Sep 28 12:35:14 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:14 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018" returned: 0 in 0.246s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:14 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:14 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.info Sep 28 12:35:14 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:15 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.info" returned: 0 in 0.256s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:15 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.info is being set with open permissions: ugo+rw Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:15 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.info Sep 28 12:35:15 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:15 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.info" returned: 0 in 0.240s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.877s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:15 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-39fe526a-c5b6-4a5e-809d-7ee2607310e2 tempest-ProjectReaderTests-1421538232 None] Create snapshot completed successfully Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-74bc7438-0988-49d7-b7dd-0d013022c018-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-74bc7438-0988-49d7-b7dd-0d013022c018-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-74bc7438-0988-49d7-b7dd-0d013022c018" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-74bc7438-0988-49d7-b7dd-0d013022c018" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Deleting offline snapshot 74bc7438-0988-49d7-b7dd-0d013022c018 of volume 3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] snapshot_file for this snap is: volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6275132-2231-41a0-83aa-7c0469bac035]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:15 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 Sep 28 12:35:15 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:15 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018" returned: 0 in 0.362s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:15 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:16 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d35f58d-984b-4dbe-a141-c3c05847a178]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:16 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b Sep 28 12:35:16 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:16 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" returned: 0 in 0.368s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:16 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 Sep 28 12:35:16 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:16 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018" returned: 0 in 0.332s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:16 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018 Sep 28 12:35:16 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:16 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:16 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b.74bc7438-0988-49d7-b7dd-0d013022c018" returned: 0 in 0.252s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-74bc7438-0988-49d7-b7dd-0d013022c018" released by "_delete_snapshot" :: held 1.425s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" released by "delete_snapshot" :: held 1.448s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Created reservations ['662df426-8345-4bab-bf6a-4c7a72afbd7e', '9a83ebb9-138b-4861-aead-471330e7e365', 'caad1fe7-97ed-4c42-86f3-69f22cbfba5c', 'dccf2967-3a68-4eeb-bb31-3318408d01e3'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:17 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Delete snapshot completed successfully. Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-241e09e2-aa37-4283-aa61-11af46474361 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-74bc7438-0988-49d7-b7dd-0d013022c018-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" acquired by "delete_volume" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[113673ae-6e11-4401-8add-ebb28a660a8f]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:17 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:17 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b Sep 28 12:35:17 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:18 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" returned: 0 in 0.362s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:18 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b Sep 28 12:35:18 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:18 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" returned: 0 in 0.269s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b" released by "delete_volume" :: held 0.696s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Created reservations ['128bdb81-31f5-492f-aea6-f3d5035f43b2', '5bdeb6d4-818b-475e-9642-48a8f9bd2440', '595fc042-124f-4024-b61b-49668748d033', 'caaa95e4-9c94-4ac9-b0af-e028c8ac13c1'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:18 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:35:18 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:18 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.261s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:18 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Deleted volume successfully. Sep 28 12:35:18 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-85b629c3-4eed-4cec-9c55-30cf826dba68 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-3e205af5-5b3e-4f8b-aa1b-2ea27230fe4b-delete_volume" released by "delete_volume" :: held 1.159s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (1d397c39-0a40-4d2b-bc62-40f4cf93bfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae45528-58b1-4dab-b15f-425bc6a61db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae45528-58b1-4dab-b15f-425bc6a61db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1594420063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5730c6-fb7d-45a2-bbd3-d40643222c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:19Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e74252-f6df-4c41-80d1-6b0dd5b8d85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7e74252-f6df-4c41-80d1-6b0dd5b8d85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584a7d4a-5dc4-4222-8612-78de6b917c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (584a7d4a-5dc4-4222-8612-78de6b917c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce5730c6-fb7d-45a2-bbd3-d40643222c96', 'volume_name': 'volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c572537-184f-4073-95ec-6139cd9d8e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c572537-184f-4073-95ec-6139cd9d8e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da145666-52a5-4bd8-97e8-ba79e758fe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:19 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Volume ce5730c6-fb7d-45a2-bbd3-d40643222c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96', 'volume_size': 1} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1594420063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce5730c6-fb7d-45a2-bbd3-d40643222c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:19Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Creating volume ce5730c6-fb7d-45a2-bbd3-d40643222c96 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:19 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:19 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 1073741824 Sep 28 12:35:19 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:19 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 1073741824" returned: 0 in 0.421s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:19 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:19 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 Sep 28 12:35:19 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:20 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96" returned: 0 in 0.267s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da145666-52a5-4bd8-97e8-ba79e758fe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a08997-6f19-496e-b09d-6eb4fc171e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:20 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Volume volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 (ce5730c6-fb7d-45a2-bbd3-d40643222c96): created successfully Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29a08997-6f19-496e-b09d-6eb4fc171e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (1d397c39-0a40-4d2b-bc62-40f4cf93bfc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:20 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-80073e20-bf7c-42b0-9060-42487a0f5505 tempest-ProjectReaderTests-1421538232 None] Created volume successfully. Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Creating offline snapshot 212f070d-a6f1-4144-a9a2-da3540facd00 of volume ce5730c6-fb7d-45a2-bbd3-d40643222c96 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bfdc8b-32c1-43a1-a986-36b8cb849680]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:20 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 Sep 28 12:35:20 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:20 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96" returned: 0 in 0.364s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:20 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:20 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 1G Sep 28 12:35:20 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:21 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 1G" returned: 0 in 0.407s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:21 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 Sep 28 12:35:21 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:21 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00" returned: 0 in 0.301s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:21 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 is being set with open permissions: ugo+rw Sep 28 12:35:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:21 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 Sep 28 12:35:21 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:21 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00" returned: 0 in 0.244s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:21 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:21 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.info Sep 28 12:35:21 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:22 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.info" returned: 0 in 0.249s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:22 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.info is being set with open permissions: ugo+rw Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:22 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.info Sep 28 12:35:22 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:22 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.info" returned: 0 in 0.246s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:22 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-d18b39df-b121-4e83-a414-2109ef2540ae tempest-ProjectReaderTests-1421538232 None] Create snapshot completed successfully Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-212f070d-a6f1-4144-a9a2-da3540facd00-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-212f070d-a6f1-4144-a9a2-da3540facd00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-ce5730c6-fb7d-45a2-bbd3-d40643222c96" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-ce5730c6-fb7d-45a2-bbd3-d40643222c96" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-212f070d-a6f1-4144-a9a2-da3540facd00" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-212f070d-a6f1-4144-a9a2-da3540facd00" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Deleting offline snapshot 212f070d-a6f1-4144-a9a2-da3540facd00 of volume ce5730c6-fb7d-45a2-bbd3-d40643222c96 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] snapshot_file for this snap is: volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d2f6d9-3e9d-433e-a32f-d4bb91e87ecf]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:22 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:22 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 Sep 28 12:35:22 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:23 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00" returned: 0 in 0.359s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:23 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:23 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ee8de7-6d6b-488f-8ecf-f8d8bd059e94]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:23 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 Sep 28 12:35:23 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:23 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96" returned: 0 in 0.356s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:23 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 Sep 28 12:35:23 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:23 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00" returned: 0 in 0.335s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:23 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:23 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00 Sep 28 12:35:23 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:24 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96.212f070d-a6f1-4144-a9a2-da3540facd00" returned: 0 in 0.256s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-212f070d-a6f1-4144-a9a2-da3540facd00" released by "_delete_snapshot" :: held 1.397s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-ce5730c6-fb7d-45a2-bbd3-d40643222c96" released by "delete_snapshot" :: held 1.419s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Created reservations ['801ed966-617a-4c58-a228-f4d22a6b0050', 'ef5de863-747e-434e-8fbb-8e2578604546', '52ca162b-8a68-456e-bf9a-c123991e0552', '9987f671-c535-4c05-9d5d-ab7c51c8972e'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:24 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Delete snapshot completed successfully. Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-80afe968-8b3d-4d26-bf88-52a8aa622108 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-212f070d-a6f1-4144-a9a2-da3540facd00-delete_snapshot" released by "delete_snapshot" :: held 1.562s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-ce5730c6-fb7d-45a2-bbd3-d40643222c96-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-ce5730c6-fb7d-45a2-bbd3-d40643222c96-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-ce5730c6-fb7d-45a2-bbd3-d40643222c96" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-ce5730c6-fb7d-45a2-bbd3-d40643222c96" acquired by "delete_volume" :: waited 0.013s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d115f-31e1-4ed4-81e3-74356fd2507b]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:24 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:25 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 Sep 28 12:35:25 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:25 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96" returned: 0 in 0.365s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:25 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96 Sep 28 12:35:25 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:25 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-ce5730c6-fb7d-45a2-bbd3-d40643222c96" returned: 0 in 0.252s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-ce5730c6-fb7d-45a2-bbd3-d40643222c96" released by "delete_volume" :: held 0.680s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Created reservations ['2964cff9-9dba-48f7-93b5-8d36574e56f7', 'a98e6854-970a-454d-97b7-f1b49763e44b', 'f63fe7be-6526-4176-b4cc-9296b2463bcc', 'c074824a-4460-4ec2-b2ab-a15debd7ef31'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:25 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:35:25 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:25 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.264s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:25 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Deleted volume successfully. Sep 28 12:35:25 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-3984deac-3319-4075-9380-4d4bf97e5694 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-ce5730c6-fb7d-45a2-bbd3-d40643222c96-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (df28697b-d399-478f-9370-6b741bd53677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbeb66b-f442-4de5-ab7d-08db16dd170f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fbeb66b-f442-4de5-ab7d-08db16dd170f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709161894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cc2a2c-9a5f-4763-a4ed-934b4335e94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:26Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3208f5f6-2fe1-493b-9ee6-686dadd6ebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3208f5f6-2fe1-493b-9ee6-686dadd6ebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84539ca4-aaa3-4bb0-a87d-d3816fc8fba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84539ca4-aaa3-4bb0-a87d-d3816fc8fba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2cc2a2c-9a5f-4763-a4ed-934b4335e94f', 'volume_name': 'volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7e5d17-09c6-439f-a622-feb841e0f90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7e5d17-09c6-439f-a622-feb841e0f90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25e0c18-1a48-4a64-8981-e402ebcdbbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:26 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Volume a2cc2a2c-9a5f-4763-a4ed-934b4335e94f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f', 'volume_size': 1} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709161894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2cc2a2c-9a5f-4763-a4ed-934b4335e94f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:26Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Creating volume a2cc2a2c-9a5f-4763-a4ed-934b4335e94f {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:26 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:26 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f 1073741824 Sep 28 12:35:26 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:26 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f 1073741824" returned: 0 in 0.434s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:26 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:27 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f Sep 28 12:35:27 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:27 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" returned: 0 in 0.248s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e25e0c18-1a48-4a64-8981-e402ebcdbbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c95061c-6fd4-4641-bad3-f5b54650fb7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:27 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Volume volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f (a2cc2a2c-9a5f-4763-a4ed-934b4335e94f): created successfully Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c95061c-6fd4-4641-bad3-f5b54650fb7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (df28697b-d399-478f-9370-6b741bd53677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:27 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-4fff1056-defa-438b-b110-c42c11b11b96 tempest-ProjectReaderTests-1421538232 None] Created volume successfully. Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Creating offline snapshot 0d7041dd-4e0c-4b62-9a17-42d469256243 of volume a2cc2a2c-9a5f-4763-a4ed-934b4335e94f {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc32c1f-742f-4ae6-9ac4-f3fe248fbcf1]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:27 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:27 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f Sep 28 12:35:27 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:28 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" returned: 0 in 0.385s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:28 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 1G Sep 28 12:35:28 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:28 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 1G" returned: 0 in 0.396s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:28 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 Sep 28 12:35:28 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:28 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243" returned: 0 in 0.313s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:28 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 is being set with open permissions: ugo+rw Sep 28 12:35:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:28 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 Sep 28 12:35:28 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:28 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:28 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243" returned: 0 in 0.260s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:29 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.info Sep 28 12:35:29 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:29 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.info" returned: 0 in 0.254s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:29 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.info is being set with open permissions: ugo+rw Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:29 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.info Sep 28 12:35:29 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:29 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.info" returned: 0 in 0.242s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:29 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-16bceffd-0af3-44b7-8045-b52fa483a621 tempest-ProjectReaderTests-1421538232 None] Create snapshot completed successfully Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-0d7041dd-4e0c-4b62-9a17-42d469256243-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-0d7041dd-4e0c-4b62-9a17-42d469256243-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-0d7041dd-4e0c-4b62-9a17-42d469256243" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-0d7041dd-4e0c-4b62-9a17-42d469256243" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Deleting offline snapshot 0d7041dd-4e0c-4b62-9a17-42d469256243 of volume a2cc2a2c-9a5f-4763-a4ed-934b4335e94f {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] snapshot_file for this snap is: volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b85f904-ec39-4aaa-8c0d-43e264aad4a2]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:29 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:29 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 Sep 28 12:35:29 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:30 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243" returned: 0 in 0.386s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:30 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:30 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[da640025-3465-4728-aaa3-efbe040e2053]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:30 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f Sep 28 12:35:30 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:30 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" returned: 0 in 0.356s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:30 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 Sep 28 12:35:30 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:30 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243" returned: 0 in 0.337s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:30 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:30 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243 Sep 28 12:35:30 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:31 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:31 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f.0d7041dd-4e0c-4b62-9a17-42d469256243" returned: 0 in 0.247s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-0d7041dd-4e0c-4b62-9a17-42d469256243" released by "_delete_snapshot" :: held 1.420s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" released by "delete_snapshot" :: held 1.445s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:31 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Created reservations ['0aabf452-fa9a-4c44-98ac-b4a30960530d', '90b9f16c-1cd0-4afe-b2dd-d09851851c3c', '140ff170-9f4c-47b2-9ab9-c60ebee6f758', '9ffb2c16-0037-4bf6-961f-c3a35d0bcb9b'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:31 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Delete snapshot completed successfully. Sep 28 12:35:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-5dbac4bd-e218-48fc-aa75-3923183d9ec2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-0d7041dd-4e0c-4b62-9a17-42d469256243-delete_snapshot" released by "delete_snapshot" :: held 1.581s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:31 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" acquired by "delete_volume" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb99d8f-1d61-4cc7-a1ec-ba9eaff186f3]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:32 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f Sep 28 12:35:32 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:32 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" returned: 0 in 0.354s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:32 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f Sep 28 12:35:32 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:32 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" returned: 0 in 0.254s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f" released by "delete_volume" :: held 0.665s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=122,cinder:INSERT=36,cinder:UPDATE=145,cinder:DELETE=4 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=106,cinder:INSERT=44,cinder:UPDATE=144,cinder:DELETE=20 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Created reservations ['3920c81d-699b-49f8-a816-40604be68df5', '1014083d-ded0-4859-88c6-1e628dfe2801', '3285d357-4ebe-45af-ad18-c3885aa0f132', '927eb4b5-be53-4f23-a98e-ffa3d99e436a'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:32 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:32 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:35:32 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:33 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.250s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:33 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Deleted volume successfully. Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-c2481f31-d134-4423-bc62-5ff76409f9a2 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-a2cc2a2c-9a5f-4763-a4ed-934b4335e94f-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.flows.manager.create_volume [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87048) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (281906eb-eb3c-4959-b39e-3d36b4018c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686b8e11-14fa-45b9-9d8b-5b5eba5c0029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (686b8e11-14fa-45b9-9d8b-5b5eba5c0029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278844267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52419bee-5ede-4c07-9b81-b287fe18ac92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:33Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abecfe7-0bb4-4715-aff2-15d427e4e817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0abecfe7-0bb4-4715-aff2-15d427e4e817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab026d8a-eb10-4574-83d7-8b12f297d881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab026d8a-eb10-4574-83d7-8b12f297d881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52419bee-5ede-4c07-9b81-b287fe18ac92', 'volume_name': 'volume-52419bee-5ede-4c07-9b81-b287fe18ac92', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e462c147-cd7d-47c5-9559-406d2719b2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e462c147-cd7d-47c5-9559-406d2719b2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aa0032-1e04-48ee-9375-070b436de07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:33 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Volume 52419bee-5ede-4c07-9b81-b287fe18ac92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52419bee-5ede-4c07-9b81-b287fe18ac92', 'volume_size': 1} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T10:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278844267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52419bee-5ede-4c07-9b81-b287fe18ac92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a634b6f9b6fd499dbda98b492ddfadcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T10:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T10:35:33Z,use_quota=True,user_id='32cd477737df47acbbdcce49bab10df9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d2796a6-26af-4f5f-842e-bfd24c1a930a),volume_type_id=6d2796a6-26af-4f5f-842e-bfd24c1a930a)}" {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Creating volume 52419bee-5ede-4c07-9b81-b287fe18ac92 {{(pid=87048) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Selected osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a as target Quobyte volume. {{(pid=87048) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 12:35:33 devstack cinder-volume[87048]: INFO cinder.volume.drivers.remotefs [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] casted to osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a Sep 28 12:35:33 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 1073741824 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:33 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 1073741824 Sep 28 12:35:33 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:34 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 1073741824" returned: 0 in 0.415s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:34 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 Sep 28 12:35:34 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:34 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92" returned: 0 in 0.267s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'} {{(pid=87048) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5aa0032-1e04-48ee-9375-070b436de07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52419bee-5ede-4c07-9b81-b287fe18ac92', 'volume_size': 1}' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd36000-4f72-4938-a7d2-1e63a2780864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 12:35:34 devstack cinder-volume[87048]: INFO cinder.volume.flows.manager.create_volume [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Volume volume-52419bee-5ede-4c07-9b81-b287fe18ac92 (52419bee-5ede-4c07-9b81-b287fe18ac92): created successfully Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd36000-4f72-4938-a7d2-1e63a2780864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87048) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Flow 'volume_create_manager' (281906eb-eb3c-4959-b39e-3d36b4018c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87048) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 12:35:34 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-415568b8-5acf-4e14-8038-a699cc6ae191 tempest-ProjectReaderTests-1421538232 None] Created volume successfully. Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Creating offline snapshot 50d5a650-0ada-474e-b986-9da2ef25696f of volume 52419bee-5ede-4c07-9b81-b287fe18ac92 {{(pid=87048) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[33011439-f945-428d-89bd-5ea161b8b0c6]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:34 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:34 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 Sep 28 12:35:34 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:35 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92" returned: 0 in 0.359s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f 1G {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:35 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f 1G Sep 28 12:35:35 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:35 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f 1G" returned: 0 in 0.384s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52419bee-5ede-4c07-9b81-b287fe18ac92 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:35 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52419bee-5ede-4c07-9b81-b287fe18ac92 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f Sep 28 12:35:35 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:35 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52419bee-5ede-4c07-9b81-b287fe18ac92 -F qcow2 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f" returned: 0 in 0.287s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:35 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f is being set with open permissions: ugo+rw Sep 28 12:35:35 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:35 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f Sep 28 12:35:35 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:36 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f" returned: 0 in 0.244s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:36 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.info Sep 28 12:35:36 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:36 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.info" returned: 0 in 0.247s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87048]: WARNING cinder.volume.drivers.remotefs [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.info is being set with open permissions: ugo+rw Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.info {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:36 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.info Sep 28 12:35:36 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:36 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.info" returned: 0 in 0.246s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.849s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:36 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-1902ce7d-0a1a-434e-b379-ba1b5e6b1cdb tempest-ProjectReaderTests-1421538232 None] Create snapshot completed successfully Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-50d5a650-0ada-474e-b986-9da2ef25696f-delete_snapshot" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-50d5a650-0ada-474e-b986-9da2ef25696f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-52419bee-5ede-4c07-9b81-b287fe18ac92" by "delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-52419bee-5ede-4c07-9b81-b287fe18ac92" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-50d5a650-0ada-474e-b986-9da2ef25696f" by "_delete_snapshot" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-50d5a650-0ada-474e-b986-9da2ef25696f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Deleting offline snapshot 50d5a650-0ada-474e-b986-9da2ef25696f of volume 52419bee-5ede-4c07-9b81-b287fe18ac92 {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] snapshot_file for this snap is: volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f {{(pid=87048) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[390b85ea-1545-449e-8d4e-9f333f9ebfcf]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:36 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:37 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f Sep 28 12:35:37 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:37 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f" returned: 0 in 0.358s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:37 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.remotefs [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52419bee-5ede-4c07-9b81-b287fe18ac92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87048) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 12:35:37 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2be809-f77a-4f9a-820e-099bfdf10616]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:37 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 Sep 28 12:35:37 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:37 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92" returned: 0 in 0.364s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:37 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:37 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f Sep 28 12:35:37 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:38 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f" returned: 0 in 0.330s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:38 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f Sep 28 12:35:38 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:38 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:35:38 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:38 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92.50d5a650-0ada-474e-b986-9da2ef25696f" returned: 0 in 0.257s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-50d5a650-0ada-474e-b986-9da2ef25696f" released by "_delete_snapshot" :: held 1.409s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-52419bee-5ede-4c07-9b81-b287fe18ac92" released by "delete_snapshot" :: held 1.434s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Created reservations ['50f5c4cf-e826-4ba9-a0c1-fcdbf8424e92', 'f9919ff9-0be8-46db-acba-fea094cdb705', '11fa6bab-52e1-4811-8e86-1d1d0097076e', '8c37f9da-2c9d-4e17-9124-39dafc137327'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:38 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.255s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG oslo_service.periodic_task [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] Running periodic task VolumeManager._thread_info {{(pid=87048) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread count: 28 {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG cinder.volume.manager [None req-92a89f43-760b-49f8-9cb2-f3e7d15766ff None None] thread info: [<_MainThread(MainThread, started 139144880828544)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87048) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 12:35:38 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Delete snapshot completed successfully. Sep 28 12:35:38 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-0745da74-8c7b-4fae-9fef-62e3fdc3c001 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-50d5a650-0ada-474e-b986-9da2ef25696f-delete_snapshot" released by "delete_snapshot" :: held 1.575s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-52419bee-5ede-4c07-9b81-b287fe18ac92-delete_volume" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-52419bee-5ede-4c07-9b81-b287fe18ac92-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "cinder-quobyte-52419bee-5ede-4c07-9b81-b287fe18ac92" by "delete_volume" {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-52419bee-5ede-4c07-9b81-b287fe18ac92" acquired by "delete_volume" :: waited 0.017s {{(pid=87048) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG oslo.privsep.daemon [-] privsep: reply[d201b492-0873-430a-9ea6-e33a5af1a644]: (4, 'qcow2') {{(pid=88192) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:39 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 Sep 28 12:35:39 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:39 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92" returned: 0 in 0.357s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:39 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92 Sep 28 12:35:39 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:39 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69/volume-52419bee-5ede-4c07-9b81-b287fe18ac92" returned: 0 in 0.247s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-quobyte-52419bee-5ede-4c07-9b81-b287fe18ac92" released by "delete_volume" :: held 0.660s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG cinder.quota [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Created reservations ['a0a9fd53-57b0-4477-b9c4-b8393d4dff1a', 'a8b69ad2-6205-467a-b36d-2a80ab0482a3', '51fa2792-f2ae-4124-bde6-333a91e6eec4', '51091ba4-86d7-4191-92d6-f8373ed03cde'] {{(pid=87048) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a': None} {{(pid=87048) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG cinder.volume.drivers.quobyte [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-e63b7fa1-413d-4009-b00a-19a95dccd97a'] {{(pid=87048) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.lockutils [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87048) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 12:35:39 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 12:35:39 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69 Sep 28 12:35:39 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 12:35:40 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 28 12:35:40 devstack cinder-volume[87048]: DEBUG oslo_concurrency.processutils [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b742f90afb443170725519b7d3ea8e69" returned: 0 in 0.253s {{(pid=87048) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 12:35:40 devstack cinder-volume[87048]: DEBUG cinder.manager [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Notifying Schedulers of capabilities ... {{(pid=87048) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 12:35:40 devstack cinder-volume[87048]: INFO cinder.volume.manager [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Deleted volume successfully. Sep 28 12:35:40 devstack cinder-volume[87048]: DEBUG cinder.coordination [None req-cfc8a79f-5acd-4729-a298-09273ce48451 tempest-ProjectReaderTests-1421538232 None] Lock "cinder-52419bee-5ede-4c07-9b81-b287fe18ac92-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87048) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 12:35:49 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:SELECT=16,cinder:INSERT=9,cinder:UPDATE=28,cinder:DELETE=1 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 12:35:50 devstack cinder-volume[87048]: DEBUG dbcounter [-] [87048] Writing DB stats cinder:UPDATE=23,cinder:SELECT=18,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87048) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}